Good reminder that raw tokens/sec numbers can be misleading without latency and context-window considerations.
hiroakiaizawa
Running simple reproducible tests on concentration of extreme events.
Colab (≈30 sec): https://colab.research.google.com/drive/1FGu7_G1avub-0PUV6cpdox8cojuOvY9C
Optional: https://zenodo.org/records/20020739
Posts2
Comments9