# meta-llama/llama-3.3-70b-instruct across inference providers

Reference: context 131,072 tokens from https://huggingface.co/unsloth/Llama-3.3-70B-Instruct/blob/99cd0d2c829e92a67c844f9144c2509632e5c87f/config.json (max_position_embeddings); quantization no publicly verifiable reference.

Meta's repository (meta-llama/Llama-3.3-70B-Instruct) is gated and cannot be read anonymously, so the context length is read from the unsloth mirror of the same weights.

Meta publishes no reference quantization that can be read anonymously (its FP8 repository answers 401 to an anonymous request, which does not say whether it exists), so the quantization each provider declares is shown and not compared.

Provider rows: https://openrouter.ai/api/v1/models/meta-llama/llama-3.3-70b-instruct/endpoints, read 2026-10-19. Declared values; no requests sent.

| Provider | Tag | Quantization | Context | Max output | Tools | Reasoning | Differs from the reference |
|---|---|---|---|---|---|---|---|
| AkashML | akashml/fp8 | fp8 (not-compared) | 131,072 | 128,000 | yes | n/a | none declared |
| Cloudflare | cloudflare/fp8 | fp8 (not-compared) | 24,000 | 21,600 | no | n/a | **declares a 24,000-token context; the reference config says 131,072 (18%)**; **declares no tools parameter; the official model supports tool calling** |
| CoreWeave | coreweave/fp16 | fp16 (not-compared) | 128,000 | 115,200 | yes | n/a | declares a 128,000-token context; the reference config says 131,072 (98%) |
| DeepInfra | deepinfra/turbo | fp8 (not-compared) | 131,072 | 16,384 | yes | n/a | none declared |
| Google | google-vertex | none (not-compared) | 128,000 | 115,200 | no | n/a | declares a 128,000-token context; the reference config says 131,072 (98%); **declares no tools parameter; the official model supports tool calling** |
| Google | google-vertex/us-central1 | none (not-compared) | 128,000 | 8,192 | yes | n/a | declares a 128,000-token context; the reference config says 131,072 (98%) |
| Groq | groq | none (not-compared) | 131,072 | 32,768 | yes | n/a | none declared |
| Novita | novita/bf16 | bf16 (not-compared) | 12,288 | 11,059 | yes | n/a | **declares a 12,288-token context; the reference config says 131,072 (9%)** |
| Parasail | parasail/fp8 | fp8 (not-compared) | 131,072 | 16,384 | no | n/a | **declares no tools parameter; the official model supports tool calling** |
| SambaNova | sambanova-turbo | none (not-compared) | 131,072 | 3,072 | no | n/a | **declares no tools parameter; the official model supports tool calling**; declares at most 3,072 output tokens |
| Together | together | none (not-compared) | 131,072 | 2,048 | yes | n/a | declares at most 2,048 output tokens |

## Changes since tracking began

None yet.