pod: 754siv8r65121u  arzach-c1a-gpu
2026-08-31T08:20:11Z
index, name, memory.total [MiB], driver_version
0, NVIDIA RTX PRO 6000 Blackwell Server Edition, 97887 MiB, 595.91.07
1, NVIDIA RTX PRO 6000 Blackwell Server Edition, 97887 MiB, 595.91.07

Python 3.11.10

=== volume mount ===
mfs#euro-3.runpod.net:9421 on /data type fuse (rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other)

=== arms ===
broken-randhead: 28
hybrid-dpo: 28
hybrid-final: 28
final: 30

=== engine facts (rep1) ===
Available KV cache memory: 18.47 GiB
GPU KV cache size: 121,072 tokens
Maximum concurrency for 4,096 tokens per request: 29.56x
Model loading took 65.7420 GiB and 182.976766 seconds
Model loading took 65.7420 GiB and 183.082222 seconds
Using Flash Attention backend
