⚙️ List Jobs Hardware
You can now list all available hardware options for Hugging Face Jobs, both from the CLI and programmatically.
From the CLI:
➜ hf jobs hardware
NAME PRETTY NAME CPU RAM ACCELERATOR COST/MIN COST/HOUR
--------------- ---------------------- -------- ------- ---------------- -------- ---------
cpu-basic CPU Basic 2 vCPU 16 GB N/A $0.0002 $0.01
cpu-upgrade CPU Upgrade 8 vCPU 32 GB N/A $0.0005 $0.03
cpu-performance CPU Performance 8 vCPU 32 GB N/A $0.0000 $0.00
cpu-xl CPU XL 16 vCPU 124 GB N/A $0.0000 $0.00
t4-small Nvidia T4 - small 4 vCPU 15 GB 1x T4 (16 GB) $0.0067 $0.40
t4-medium Nvidia T4 - medium 8 vCPU 30 GB 1x T4 (16 GB) $0.0100 $0.60
a10g-small Nvidia A10G - small 4 vCPU 15 GB 1x A10G (24 GB) $0.0167 $1.00
a10g-large Nvidia A10G - large 12 vCPU 46 GB 1x A10G (24 GB) $0.0250 $1.50
a10g-largex2 2x Nvidia A10G - large 24 vCPU 92 GB 2x A10G (48 GB) $0.0500 $3.00
a10g-largex4 4x Nvidia A10G - large 48 vCPU 184 GB 4x A10G (96 GB) $0.0833 $5.00
a100-large Nvidia A100 - large 12 vCPU 142 GB 1x A100 (80 GB) $0.0417 $2.50
a100x4 4x Nvidia A100 48 vCPU 568 GB 4x A100 (320 GB) $0.1667 $10.00
a100x8 8x Nvidia A100 96 vCPU 1136 GB 8x A100 (640 GB) $0.3333 $20.00
l4x1 1x Nvidia L4 8 vCPU 30 GB 1x L4 (24 GB) $0.0133 $0.80
l4x4 4x Nvidia L4 48 vCPU 186 GB 4x L4 (96 GB) $0.0633 $3.80
l40sx1 1x Nvidia L40S 8 vCPU 62 GB 1x L40S (48 GB) $0.0300 $1.80
l40sx4 4x Nvidia L40S 48 vCPU 382 GB 4x L40S (192 GB) $0.1383 $8.30
l40sx8 8x Nvidia L40S 192 vCPU 1534 GB 8x L40S (384 GB) $0.3917 $23.50 Programmatically:
>>> from huggingface_hub import HfApi
>>> api = HfApi()
>>> hardware_list = api.list_jobs_hardware()
>>> hardware_list[0]
JobHardware(name='cpu-basic', pretty_name='CPU Basic', cpu='2 vCPU', ram='16 GB', accelerator=None, unit_cost_micro_usd=167, unit_cost_usd=0.000167, unit_label='minute')
>>> hardware_list[0].name
'cpu-basic'🐛 Bug Fixes
- Fix severe performance regression in streaming by keeping a byte iterator in
HfFileSystemStreamFilein #3685 by @leq6c - [Cache] Fix verify incorrectly reporting folders as missing files in #3707 by @Mitix-EPI
- [HfFileSystem] Fix
resolve_path() with special char @ in #3704 by @lhoestq - [Inference] Fix curlify with streaming request in #3692 by @hanouticelina
✨ Various Improvements
- Add
num_papersfield to Organization class in #3695 by @cfahlgren1 - Add
limitparam tolist_papersAPI method in #3697 by @Wauplin - Add repo commit count warning when exceeding recommended limits in #3698 by @Wauplin
- Update
MAX_FILE_SIZE_GBfrom 50 to 200 GB in #3696 by @davanstrien
📚 Documentation
- Wildcard pattern documentation in #3710 by @hanouticelina