Can models affect data centre power usage?
Edward Grundy , Bay Information Systems
The inaugural AI Wales Tech talk looked at per-request power, VRAM and timing data for 50+ open-weight models across 21k prompts, the kind of telemetry that is normally only visible to data centre operators and frontier labs.
The dataset and notebooks are open on GitHub for anyone to explore, extend or challenge via a pull request.
Links
- Dataset and notebooks on GitHub
- Bay Information Systems
- Data collected using the Marigold platform