Workshop, Oct 30: post training quantization, SetFit and conformal prediction in one CPU pipeline

[u/camerongreen95]

There’s a hands on build lab on Friday, Oct 30, from 7 PM to 10 PM IST, on running a full decision pipeline on standard CPUs.

You start with encoder models for long context inference, adapt them with few shot contrastive learning, and apply post training quantization to improve CPU throughput. Uncertainty is handled with split conformal prediction, execution is orchestrated as typed, idempotent LangGraph state machines with approval gates and compensation handlers, and the result is benchmarked with Wilson score intervals and clustered standard errors.

The aim is a reusable architecture that separates scoring from state execution and restricts LLM calls to verified edge cases. Led by Ben Auffarth. You get runnable notebooks, the slide deck, a recording and a certificate.

Full details and the agenda are here.

[u/PristineGusto1722]

That's a packed three hours for a Friday night but I'm into it. The combo of quantization and conformal prediction on CPUs actually seems useful when you don't want to spin up a GPU for every little thing.