(01)

Changelog

Every release, fix, policy and incident.

Written by the engineers who shipped it. Incidents stay on this page after they are fixed.

Written by the engineers who shipped it. Incidents stay on this page after they are fixed.

(02)

Changelog

What shipped, what broke, what we fixed.

Release

v4.2

Spend caps per project

Caps can now be set per project as well as per team. Jobs that would cross a cap are held, and the owner is asked.

Fix

v4.1.3

Faster resume after node loss

Training runs now resume from the last checkpoint in under 40 seconds on most pools, down from about three minutes.

Policy

Policy 41

EU residency policy pack

A ready-made set of rules that keeps datasets and the jobs that read them inside EU regions.

Release

v4.1

Region view in the Terminal

A new pane shows each region's power, GPUs and queue depth side by side. Press R to open it.

Incident

INC-0812

Scheduler delay in us-east-2

Jobs in one region waited up to 11 minutes to start for 34 minutes. Cause and fix are in the write-up.

Release

v4.0

Overhead 4.0

The new Terminal, policy files in your own repository and a rebuilt inventory that reads colocation sites.

Fix

v3.9.2

Audit export as CSV and JSON

Audit exports can now be downloaded in either format and filtered by team, region or policy.

Policy

Policy 33

Cost guardrails pack

Sensible daily caps, alert levels and approvers for teams that are new to shared GPU pools.

Next step

Want this in your inbox?

One email when something ships. Unsubscribe in one click.

Create a free website with Framer, the website builder loved by startups, designers and agencies.