Beam (Reflection)
Beam (released as Beam 1.0, model identifier Beam-1.0-501B-A23B) is a text-only large language model developed by Reflection AI for coding, reasoning and agentic tasks. It is a sparse mixture-of-experts model with about 501 billion total parameters, of which about 23 billion are active per token.[1][10] Reflection announced Beam on October 5, 2026, as a selective preview, and released the open weights on Hugging Face on October 16, 2026, under the Apache License 2.0.[1][9] The release included BF16, FP8 and NVFP4 checkpoints, a DFlash2 speculative decoding drafter, a tokenizer and reference implementation, a safety technical report, and Mirror CLI, the open-source coding harness Reflection says it built and trained Beam on.[9][13] Reflection describes Beam as its first open-weight model and the first in a series.[1][9] On release day, the vLLM project published day-zero serving support built with Inferact and NVIDIA, and the SkyRL team announced day-zero support for reinforcement-learning fine-tuning.[24][26][28]
Release history
Preview (October 5-15, 2026)
On October 5, 2026, Reflection published "Introducing Beam: Reflection's 501B open-weight model". The post said Beam was undergoing final red-teaming and evaluations, offered early access through a waitlist, and said the weights, technical report, model card and developer artifacts would follow later in October, with the weights under Apache 2.0.[1] On October 8, Reflection added a note to the post saying it had updated Beam's benchmark results.[1]
During the preview, the developer documentation listed the API model as Beam-501B-A23B with a 256K-token beta context window (prompt and output combined) and a 128K-token maximum output, and warned that the context window might change during the beta.[2]
Open-weight release (October 16, 2026)
On October 16, 2026, Reflection published "Beam is now available" and released the weights on Hugging Face under Apache 2.0.[9] Its announcement on X said the release included weights, the tokenizer and a reference implementation; BF16, FP8 and NVFP4 weights and a DFlash2 drafter; and Mirror CLI, "the open source harness we built and trained Beam on". It described the launch as being "in collaboration with an ecosystem of 40+ partners".[13]
The Hugging Face collection "Beam 1.0" contains four repositories:[10][11][16][17]
| Repository | Contents | Notes |
|---|---|---|
reflection/Beam-1.0-501B-A23B | Instruction-tuned model, BF16 | 933.81 GiB checkpoint[15] |
reflection/Beam-1.0-501B-A23B-FP8 | FP8 quantization | 468.72 GiB; quantized with LLM Compressor[15][17] |
reflection/Beam-1.0-501B-A23B-NVFP4 | NVFP4 quantization | 273 GiB; quantized with NVIDIA Model Optimizer[15][16] |
reflection/Beam-1.0-501B-A23B-DFlash2 | Speculative decoding drafter | 1.93 billion parameters; not a standalone model[11] |
Reflection's model card lists the release as instruction-tuned only; no separate base-model checkpoint is listed in the collection.[10] At release, the model card still listed the technical report as "coming", while Reflection published a separate Beam Safety Technical Report.[10][12]
Reflection's release post calls the surrounding stack "an open operating system for agents", in which "the model is the kernel" and the agent integrations, deployment containers, inference integrations and customization pipelines above the infrastructure layer are open.[9]
Architecture and specifications
The Hugging Face model card gives these specifications:[10]
| Property | Value |
|---|---|
| Architecture | Sparse mixture of experts |
| Total parameters | 501.3B |
| Active parameters | 23.4B |
| Layers | 52 (3 dense + 49 MoE) |
| Attention | Gated GQA + sliding window attention |
| Experts | 256 |
| Context length | 1M tokens |
| Vocabulary | 152K tokens |
| Modalities | Text in, text out |
| Chat template | Modified Harmony format |
| Released numerics | BF16, FP8, NVFP4 |
| Knowledge cutoff | June 30, 2026 |
| Language | Developed predominantly for English |
| License | Apache 2.0 |
Reflection's launch post describes the design as combining interleaved local and global attention, fine-grained routed experts, a controlled residual stream and several forms of load balancing.[1] For the residual stream it describes a depth-based scaling approach, combined with SandwichNorm, elementwise attention gating and FP32 residual accumulation, to keep activation growth and outliers in check. Reflection says residual-stream RMS stayed bounded across all 52 layers during pretraining.[1]
Layer details
Implementation write-ups from the vLLM and SkyRL teams describe Beam's layers in more detail than the model card:[24][26]
| Component | Detail |
|---|---|
| Layers | 52 decoder layers, hidden size 5,120 |
| Attention layout | 43 sliding-window layers over the last 512 tokens with RoPE; 9 full-attention layers (every sixth layer, plus the last) with no positional encoding (NoPE) |
| Long-context scaling | SSMax on the NoPE layers scales each query by (1 + p/2048)^0.1, where p is the 1-based position, so the softmax sharpens as context grows |
| Heads | 48 query heads, 8 key-value heads, head dimension 128, with per-head RMSNorm on queries and keys |
| Output gate | Each head's output is multiplied by a sigmoid gate with a learned per-head bias before the output projection, so a head can be turned down or off token by token |
| Experts | 256 routed experts (feed-forward width 2,560); sigmoid scores plus a correction bias select 4 of 8 expert groups, then the top 8 experts; renormalized weights are scaled by 2.5; no shared expert |
| Dense layers | Layers 0-2 use a dense SwiGLU MLP (feed-forward width 20,480) |
| Router | Router weights, accumulation and logits kept in FP32 |
| Residual stream | RMSNorm before and after every sublayer; the n-th residual add computes h = sqrt((n-1)/n) * h + x / sqrt(n) instead of h + x |
| Output logits | Soft-capped as 30 * tanh(z / 30) |
Because only the 9 full-attention layers keep keys and values for the whole sequence, vLLM puts Beam's KV cache at 36 KiB per token in BF16 and 18 KiB in FP8, or about 18 GiB of FP8 cache for a full 1M-token context before sharding.[24]
Expert routing
Beam's expert balancing builds on auxiliary-loss-free balancing, with cosine-decayed expert-bias updates.[1] Reflection also uses sequence-level balancing and reports that the busiest expert's load, averaged across MoE layers, reached 1.04x at the end of pretraining, which it describes as near-uniform utilization.[1]
The preceding DeepSeek-V3 method adds an adjustable bias to each expert's routing score. Recent loads determine bias updates; the bias changes expert selection, rather than the value that weights an expert's output.[8] vLLM's write-up says Beam routes tokens the same way as DeepSeek-V3 but, unlike DeepSeek-V3, has no shared expert.[24]
Chat format
Beam reads and writes "Beam Harmony", which builds on OpenAI Harmony, the format used by gpt-oss. Reflection's documentation lists these differences:[21]
| Feature | OpenAI Harmony | Beam Harmony |
|---|---|---|
| Channels | analysis, commentary, final | analysis, final |
| Tool calls | commentary channel, JSON arguments | analysis channel, XML arguments |
| Tool names | functions. namespace | Bare names |
| Reasoning effort | A label, such as Reasoning: high | An integer, such as Reasoning effort: 128 |
Reflection says it chose XML arguments because JSON escaping interacts poorly with code inside tool arguments, and that Beam was trained to reason on every turn, so each assistant turn starts with a non-empty analysis message.[21]
Training
Pretraining
Reflection reports pretraining Beam on 23.8 trillion tokens drawn from the web, public sources and proprietary licensed datasets.[1] The model card says the corpus includes general web content, source code, technical documentation, reference material, and educational and scientific documents, and that processing included quality filtering, exact and approximate deduplication, and benchmark decontamination.[10] According to Reflection, about 95% of raw internet tokens were removed through parsing, deduplication and curation, and an OCR pipeline built on a vision-language model converted PDF material into training text.[1]
Reflection says Beam was pretrained end to end in under four weeks on a cluster of 6,144 NVIDIA GB300 NVL72 GPUs, with nine semi-automatic rewinds caused by gradient-norm spikes or suspected silent data corruption, and goodput reaching 92.3% toward the end of the run.[1] A midtraining stage extended Beam's effective context length to 1M tokens.[1]
Reinforcement learning
Reflection reports a four-week reinforcement-learning run using 10,500 NVIDIA GB300 GPUs and more than 100 million rollouts.[1] Its launch post adds the following details, all reported by Reflection:[1]
| Item | Reported figure |
|---|---|
| Maximum rollout context | 256K tokens |
| Environments | Nearly one million coding, agentic and STEM environments |
| Sandboxes used for training and grading | About 1.3 billion |
| Average concurrent rollouts | 110,000 |
| Peak concurrent sandboxes | 170,000 |
| Inference-to-training GPU ratio | 3.9:1 to 5.4:1 |
| Median weight-update propagation to the inference fleet | About 12 seconds |
| Staleness at which training numerics stayed stable | One day (107 weight versions behind the current policy) |
Beam was trained with asynchronous policy gradients. Reflection says it developed new algorithms to keep learning stable when rollouts mix tokens from many model checkpoints, and to reduce numerical mismatch between the training and inference engines.[1] It also trained with a controllable length penalty; the reasoning-effort setting exposed in the API lets users trade answer quality against token use.[1] Reflection reports that browsing performance improved during an RL phase that contained no browsing tasks.[1]
For the open release, Reflection said its largest RL runs used roughly 1.3 billion sandboxes across training, evaluation and ablations, and that its sandbox fleet peaked at 883,006 vCPUs across 23 clusters on Google Cloud and AWS.[9]
Alignment
Reflection trained a second model from the pretrained checkpoint with a separate SFT and RL pipeline aimed at safety and alignment, then merged the RL teacher and the safety teacher through multi-teacher on-policy distillation (MOPD).[1][12] Safety SFT followed the deliberative-alignment approach of Guan et al. (2024): traces are generated with the safety policy in the system prompt, filtered by an LLM judge, rewritten, and then trained without the policy in context.[12] The safety report says safety data made up 1.62% of the alignment teacher's SFT dataset and that the safety RL environment held a fixed 5% weight in that teacher's RL mixture, with a 1:5 harmless-to-harmful task ratio.[12]
Vendor-reported evaluation
All figures below were reported by Reflection, not measured independently. The model card's numbers (evaluated at temperature 0.7, top-p 0.99) supersede the earlier launch-post figures in several places; for example, SWE-bench Verified is 80.9 in the launch post but 81.6% for the BF16 checkpoint on the model card.[1][10]
| Benchmark | Launch post (updated Oct 8)[1] | Model card BF16[10] | FP8[10] | NVFP4[10] |
|---|---|---|---|---|
| DeepSWE v1.1 | 44.4 | 43.3% | 43.0% | 42.7% |
| SWE-Bench Pro v2-Hard | 77.2 | 76.5% | 78.4% | 78.6% |
| SWE-Bench Pro v1 | 65.5 | 66.1% | 65.9% | 65.6% |
| Terminal-Bench v2.1 | 80.1 | 80.1% | 78.9% | 78.4% |
| SWE Atlas Codebase QnA | 34.6 | 31.8% | 32.2% | 31.4% |
| SWE-bench Multilingual | 78.0 | 78.3% | 78.1% | 77.5% |
| SWE-bench Verified | 80.9 | 81.6% | 80.2% | 80.7% |
| AIME 2026 | 97.8 | 97.7% | 98.0% | 97.5% |
| Humanity's Last Exam (no tools) | 36.2 | 36.0% | 36.0% | 34.8% |
| Humanity's Last Exam (with tools) | Not listed | 51.1% | 51.1% | 51.1% |
| SciCode | 49.7 | 49.2% | 48.3% | 46.9% |
| CriPT AA | 16.3 | 16.3% | 17.4% | 15.4% |
| GPQA Diamond | 90.5 | 90.6% | 90.3% | 89.3% |
| LiveCodeBench | Not listed | 88.3% | 88.1% | 87.4% |
| AutomationBench (public split) | 37.0 | 39.3% | 38.2% | 39.8% |
| MCP Atlas | 78.7 | 80.8% | 81.5% | 80.5% |
| Tau3 Banking | 38.0 | 36.1% | 36.8% | 35.4% |
| BrowseComp (with context management) | 77.4 | 76.8% | 76.7% | 75.6% |
| DeepSearchQA (with context management) | 80.1 | 80.5% | 79.6% | 81.1% |
| AA-LCR | 79.3 | 78.2% | 79.4% | 78.7% |
| LongBench v2 | 65.5 | 67.5% | 67.6% | 67.2% |
| IFBench | 79.7 | 79.6% | 80.7% | 79.2% |
| AA Omniscience index (public split) | 13.0 | 10.8 | 8.8 | 9.8 |
In the launch post, Reflection compared Beam with Inkling, Nemotron 3 Ultra, GLM-5.2, GLM-5.3, Kimi K3, Qwen 3.8 Max and DeepSeek V4.1 Flash. It said Beam is competitive with larger open models such as GLM-5.2 and approaches Qwen 3.8-Max on coding and agentic tasks, while conceding that "frontier open models like Kimi K3 remain ahead on raw capability".[1] Reflection's central claim is inference efficiency: it says Beam reaches scores comparable to GLM-5.2 on advanced reasoning benchmarks with 3-4x less inference compute, and the model card says it reaches comparable quality to leading open models with about 3x fewer reasoning tokens.[1][10]
Reflection estimates generation compute as 2 × active parameters × mean generated tokens per attempt, including reasoning and answers. The estimate excludes prompt prefill, context-dependent attention and serving overhead. It is an approximate compute comparison, not measured inference cost.[1]
Independent evaluation
Artificial Analysis lists Beam 1.0 with a score of 30 on its Intelligence Index (version 4.3.2), ranking it 19th of 120 models, against a median of 19 for comparable models. It reports that Beam generated 79 million output tokens while running the index, compared with a median of 130 million, ranking 10th of 46 for verbosity. The same page lists a price of $1.30 per million input tokens and $4.30 per million output tokens, which it rates as expensive compared with open-weight models of similar size.[23]
Inference and deployment
Self-hosting
Reflection's reference self-hosting setup is four NVIDIA B300 SXM GPUs connected by NVLink on a Linux amd64 host, using the NVFP4 checkpoint and the DFlash2 drafter.[15] The documentation provides single-server guides for SGLang, vLLM and LightSeek's TokenSpeed, a Kubernetes Helm chart developed with Dell, scale-out guides for NVIDIA Dynamo, a Transformers cookbook, and a "Beam Verifier" tool for checking a deployment's correctness and comparing its performance to reference numbers.[19][20] Reflection lists day-zero support in Transformers (Hugging Face), vLLM (Inferact), SGLang (RadixArk), Unsloth, Axolotl, TokenSpeed (LightSeek Foundation) and Dynamo (NVIDIA).[9]
On the day of release, NVIDIA said on X that Beam was trained on NVIDIA GB300 NVL72 and "delivers over 70K tokens/sec/GPU on Blackwell Ultra out of the box on day 0". This is NVIDIA's own figure.[14]
vLLM serving
The vLLM project published "Serving Reflection Beam on vLLM from Day 0" on October 16, 2026, credited to Inferact, Reflection and NVIDIA.[24] The post says reasoning, tool calling and structured outputs work out of the box, and that the model can run with tensor, data or expert parallelism. Support shipped as a dedicated Docker image, vllm/vllm-openai:reflection-beam; vLLM's Beam recipe, updated October 16, says Beam support "has not shipped in a vLLM release yet".[24][25] The beam reasoning and tool-call parsers read the response template that ships with the checkpoint, and by default vLLM constrains every response to that template so that tool calls always parse and match each tool's JSON schema. Setting VLLM_BEAM_ALWAYS_CONSTRAIN_OUTPUT=0 turns the constraint off.[24][25] Served through vLLM, Beam reasons at the maximum effort, max (512), unless a request sets reasoning_effort.[25]
The recipe lists these targets (sizes in decimal gigabytes; minimum GPU memory is the total across all GPUs, including 20% headroom over the weights):[25]
| Checkpoint | Weights on disk | Minimum GPU memory | Recommended hardware |
|---|---|---|---|
| NVFP4 (default) | 294 GB | 353 GB | 4x B200/B300 or one GB200/GB300 tray (TP4); 8x H100 (TP8, Marlin) |
| FP8 | 503 GB | 604 GB | 8x H200 (TP8) |
| BF16 | 1,003 GB | 1,204 GB | 8x B200/B300 (TP8) |
On Blackwell GPUs the NVFP4 checkpoint runs W4A4; on Hopper GPUs, vLLM serves its FP4 experts through Marlin kernels with BF16 activations. The recipe says Beam's kernels, including a custom all-reduce used with expert parallelism, are CUDA-only.[25]
Agent-driven kernel optimization
vLLM says its first Beam implementation was "an unoptimized, almost pure PyTorch version of the model", which coding agents then optimized autonomously by profiling the model, writing kernels and benchmarking each change.[24] On TP8 on GB200, seven changes cut batch-1 decode from 8.95 ms to 3.30 ms per step (2.71x faster) and an 8 x 2,048-token prefill at about 100K context from 328 ms to 176 ms (1.87x). They included fusing the post-norm, scaled residual add and next pre-norm at each of the 104 sublayer boundaries into one Triton kernel, which vLLM credits with a 40% cut in decode time; running both tensor-parallel all-reduces inside the norm kernels, using FlashInfer's multicast all-reduce; packing the Q, K, V and gate projections into one GEMM; and adding Beam's 5120 x 256 shape to vLLM's small-batch FP32 router kernel. After the changes, one MoE layer runs as 13 kernels in batch-1 TP8 decode. Six were written, fused or extended for Beam; the other seven come from libraries, and vLLM says most of the remaining time is spent in them.[24]
Reported throughput
All figures below are vLLM's own measurements:[24]
| Test | Setup | Reported result |
|---|---|---|
| Peak prefill (input) throughput | 4x GB300, 32K-token input, 1-token output | 168.8K tokens/s with attention data parallelism plus FlashInfer's CuTe DSL NVFP4 MegaMoE kernel, versus 98.7K tokens/s with tensor parallelism (1.71x) |
| Single-request decode with DFlash2 | TP8, low-entropy category of SPEED-Bench's throughput_1k split, greedy decoding | 708 tokens/s, acceptance length 3.71 |
| AgentX (replayed multi-turn coding conversations) | Beam NVFP4 on 4x GB300, TP4, FP8 KV cache, DFlash2, maximum reasoning effort | About 88K total tokens/s per GPU at 96 concurrent requests, counting input and output tokens including cached input (input cache hit rates 91.4-95.6% across the sweep); up to 350 tokens/s per user |
Speculative decoding in vLLM
vLLM supports the DFlash2 drafter from day 0. It fuses the drafter's convolution, norms and KV writes, runs the whole draft step in a CUDA graph, and says FP8 KV cache works for the drafter with no change in acceptance.[24] The recipe recommends 7 speculative tokens (the drafter supports up to 15) and says the drafter adds about 1.7 GB per GPU, which reduces KV-cache capacity.[25] vLLM also offers adaptive verification for the drafter: with enable_adaptive_verification, it predicts how likely each draft token is to be accepted and verifies only the tokens worth their cost, instead of a fixed number per step. Because DFlash2 has no confidence head, the estimate comes from the drafter's own logits.[24] vLLM's results on TP8, on the SPEED-Bench low-entropy category (about 1K-token prompts, mostly code completion and text sorting, greedy decoding, up to 4K output tokens):[24]
| Concurrency | Fixed draft (tokens/s) | Adaptive (tokens/s) | Change | Acceptance length |
|---|---|---|---|---|
| 1 | 708 | 707 | -0.1% | 3.71 to 3.61 |
| 8 | 3,232 | 3,221 | -0.3% | 3.67 to 3.57 |
| 32 | 7,744 | 8,275 | +6.9% | 3.68 to 3.29 |
| 128 | 15,012 | 16,632 | +10.8% | 3.68 to 3.23 |
At concurrency 128, vLLM says adaptive verification also cut p99 time per output token by 9%. It warns that low-entropy text is easier to predict, so acceptance will be lower on open-ended chat.[24] These acceptance lengths come from a different benchmark than Reflection's own DFlash2 figures above.
Quantized checkpoints
| Checkpoint | Scheme | Coverage | Method |
|---|---|---|---|
| FP8 | FP8_DYNAMIC (W8A8), FP8 E4M3 weights and activations; per-output-channel weight scales, per-token dynamic activation scales | Attention projections (including the attention gate), dense MLPs and MoE experts; embeddings, LM head, routers and norms stay at original precision | Round-to-nearest post-training quantization with LLM Compressor; no calibration data[17] |
| NVFP4 | W4A4, 4-bit E2M1 values with one FP8 E4M3 scale per 16-value block plus a per-tensor global scale | Routed-expert MLPs in layers 3-51 only; dense MLPs in layers 0-2, attention, routers, embeddings, LM head and norms stay BF16 | Post-training quantization with NVIDIA Model Optimizer using Local Hessian calibration on 1,000 sequences of 32,768 tokens of long-context agentic data[16] |
Reflection says the NVFP4 checkpoint is about 3.4x smaller than the BF16 release (273 GiB versus 934 GiB), so a full copy fits on four B300 GPUs, and that native NVFP4 requires NVIDIA Blackwell GPUs.[16] For the FP8 checkpoint, measured on an eight-GPU H200 endpoint with a BF16 KV cache, it reports mean GPU memory use per GPU falling from 135.08 GiB in BF16 to 88.40 GiB.[17] Reflection credits four NVIDIA engineers with guidance on its quantization recipes.[16]
DFlash2 drafter
The drafter uses DFlash2, a method from Inco AI that builds on DFlash, a block-diffusion speculative decoding method.[11][18] It drafts a whole block of tokens in one forward pass, keeps the top candidates at each position, and uses a small selector to pick one path. It conditions on hidden states from five of Beam's layers (4, 16, 28, 40 and 46), reuses Beam's frozen embedding and LM head, and attends over a 4,096-token sliding window so drafting cost does not grow with context length.[11] It has 1.93 billion parameters across 5 layers, was trained with a block size of 16, and is recommended for serving with a block size of 8. With rejection sampling, Beam verifies every drafted token and its output distribution is unchanged.[11]
Reflection's figures, measured with Beam NVFP4 on four B300 GPUs with greedy decoding:[11][18]
| Benchmark | Acceptance length (of 8) | Speedup, concurrency 1 | Concurrency 16 | Concurrency 32 |
|---|---|---|---|---|
| GSM8K | 5.88 | 3.03x | 2.51x | 2.75x |
| MATH-500 | 5.39 | 2.99x | 2.42x | 2.52x |
| HumanEval | 4.68 | 2.54x | 2.20x | 2.34x |
| MBPP | 4.32 | 2.30x | 2.07x | 2.21x |
| MT-Bench | 4.11 | 1.96x | 1.72x | 1.89x |
On replayed agentic coding traces from DeepSWE, the mean acceptance length was 4.82 overall, 5.72 for prompts under 2K tokens and 4.23 for prompts of 64K-128K tokens.[11]
Hosted access
Reflection's announcement lists launch availability on Amazon Web Services, Nscale, Applied Compute, Baseten, Cloudflare, CoreWeave, Databricks, Fireworks AI, Google Cloud, Hermes, LM Studio, Microsoft Azure, Modal, Nebius, NVIDIA NIM, Ollama, OpenCode, OpenRouter, Oracle, Together AI, Vercel and Weights & Biases, with Dell and HPE delivering Beam for on-premises, sovereign and air-gapped environments.[9] Reflection's developer documentation, however, lists Microsoft Azure (Foundry Models) and Oracle (OCI Enterprise AI) as "coming soon", with AWS available through Amazon SageMaker AI and Google Cloud through Model Garden.[19]
API use
At the October 16 release, Reflection invited developers to sign up for a public beta of its first-party API at platform.reflection.ai, which it said is free to start.[9] Its OpenAI-compatible base URL is https://api.reflection.ai/openai/v1, supporting Chat Completions and Models; a Reflection-native endpoint sits at https://api.reflection.ai/v1. This is Reflection's service, rather than an OpenAI-hosted model.[4]
The released model's API identifier is Beam-1.0-501B-A23B, replacing the preview identifier Beam-501B-A23B. The documentation now lists a 1M-token context window (1,048,576 tokens, prompt and output combined), a 128K-token maximum output (131,072 tokens) and a knowledge cutoff of June 30, 2026.[2]
Reasoning controls
Beam-1.0-501B-A23B always reasons. Its reasoning_effort values are low, medium, high, xhigh and max, and no value turns reasoning off. When a request omits the setting, the model's default effort applies; the documentation says this default can differ between organizations, and its example model object shows max.[3][2] Unsupported values such as none and minimal return a 400 error.[3]
The response separates message.reasoning_content from the final answer in message.content. Reasoning tokens count toward the completion budget. If that budget runs out during reasoning, finish_reason can be length and the answer can be null.[3] In multi-turn conversations, every prior assistant message must be sent back with its non-empty reasoning_content, or the request fails with a 400 error.[3]
Tool calls and structured output
With function calling, Beam requests application-defined functions; the application executes them and returns results. Its generated JSON arguments require validation before use. The conversation must retain the assistant's tool-call message, including reasoning, followed by one tool-result message for each call.[6]
Structured output uses response_format: json_object requests a JSON object, while json_schema supplies a schema. Strict schema mode requires every object to set additionalProperties: false and require all its properties. Applications must check for refusals and truncated output before parsing the answer.[7]
Mirror CLI and agent harnesses
Mirror CLI is Reflection's terminal coding agent. It reads and edits files, runs commands, and can run parallel tasks in separate repository worktrees; it uses Reflection's API and Beam-1.0-501B-A23B by default.[22][5] Reflection says it trained Beam together with the Mirror harness, and that Mirror began as an internal tool with isolated workspaces, background sessions and Slack, Linear and GitHub integrations before being open-sourced.[9] Its architecture pairs a Python frontend for prompts, skills and developer tooling with a Rust agent core that drives the model; Reflection says the minimal core doubles as an evaluation surface.[9]
The source code is at github.com/reflection-oss/mirror under Apache 2.0, and the package installs with uv tool install reflection-mirror.[22] The documentation describes Mirror as being in early beta and lists support for macOS 15 or later on Apple Silicon and Linux (glibc 2.28 or later) on x86-64 or ARM64; native Windows is not supported.[5] The Beam safety report notes that Reflection's internal cyber evaluations ran through the publicly available version of Mirror.[12]
Reflection also documents Beam configurations for Pi, OpenCode and Hermes Agent. These integrations use the model identifier, the OpenAI-compatible endpoint and a Reflection API key.[5] Reflection's release post says early users tested Beam in stealth previews under codenames, including "MissingNo" through Nous Portal with Hermes and "Catjam" with OpenCode.[9]
Customization
The model card says Reflection does not prohibit distillation, use of outputs to train other models, fine-tuning, parameter-efficient adaptation, quantization, merging, authorized defensive security research or good-faith adversarial evaluation.[10] Reflection lists support in NVIDIA NeMo AutoModel, Megatron Bridge and Axolotl for supervised fine-tuning, and in Miles (RadixArk), NeMo RL (NVIDIA) and SkyRL for reinforcement learning; at release, the per-stack recipes were marked "coming soon".[20] The release post also names Hugging Face TRL as a partner, describes a self-distillation loop that trains a LoRA adapter on verified traces (with recipes promised "in the coming days"), and says Reflection will adopt the OpenEnv environment standard for future runs.[9]
Reinforcement learning with SkyRL
SkyRL, an Apache-2.0 reinforcement-learning library for language models from NovaSky (a group at UC Berkeley's Sky Computing Lab), announced day-zero support for Beam on October 16, 2026.[26][29][30] It covers LoRA, BF16 full fine-tuning and MXFP8 RL, with vLLM generating rollouts and Megatron training the model.[27][28] SkyRL says it worked from the official vLLM branch for Beam and the Megatron-Bridge implementation Reflection provided, and thanks Reflection for early access to the model.[26] Beam support lives on SkyRL's beam-release branch, not its main branch, and runs from a Docker image that carries Beam builds of vLLM and Megatron-Bridge.[27] Reflection's own customization page still marked its per-stack recipes "coming soon" when checked on October 19, 2026.[20]
SkyRL validated training with the DAPO recipe (GRPO with clip-higher and DAPO's overlong-response penalty, without dynamic sampling) on DAPO-Math-17K, evaluating on AIME24 and AIME25. The runs used minimal reasoning effort (set through Beam's chat template; Reflection's hosted API does not accept minimal), 50 training steps (100 optimizer updates) and Rollout Routing Replay (R3), and SkyRL describes them as short validation runs that finished in 5 hours.[26][27] It reported these results:[26][27]
| Configuration | Hardware | Reported outcome |
|---|---|---|
| LoRA (rank 64, alpha 64, on all linear layers; each of the 256 experts gets its own adapter) | 4 nodes of 8 B200 GPUs (a 2-node script is also provided) | AIME25 average accuracy over 8 samples rose from 61% to 79%; SkyRL reports LoRA and full fine-tuning at parity |
| BF16 full fine-tuning | 8 nodes of 8 B200 GPUs | Same 61% to 79% gain on AIME25 |
| MXFP8 full fine-tuning with MXFP8 rollouts | 8 nodes of 8 B200 GPUs | Reward, evaluation accuracy and response length tracked the BF16 run closely; generation throughput rose 44% |
The average absolute difference between training-side and inference-side log-probabilities was about 0.02 without R3 and about 0.008 with it for BF16 rollouts, and about 0.03 with R3 for MXFP8 rollouts, where SkyRL also turned on geometric sequence masking as an off-policy correction.[26][27] SkyRL also noted Beam's short reasoning: at minimal effort the model averaged about 1.4K tokens on AIME25.[26]
SkyRL described several changes needed at 501B scale:[26]
- Expert LoRA sizing in vLLM. With LoRA on every expert, rollouts were initially about 2.7x slower than the base model. vLLM padded each expert adapter slot to the full rank, although with
normalize_moe_loraeach expert adapter has rank r/top-k (8 for rank 64). Sizing the slots at their true rank raised decode throughput by 62% (276 to 447 tokens/s per GPU) and freed 10 GiB per GPU for the KV cache. - Optimizer state on disk. With Megatron's CPU optimizer offload, full fine-tuning needed about 18 bytes of host memory per parameter (FP32 master weights and Adam moments, an FP32 gradient copy and offloaded BF16 weights), about 9 TB in total; with the other memory used by colocated training, this exhausted the roughly 13.5 TB of host RAM across 8 nodes. SkyRL instead streams each rank's optimizer state from node-local NVMe, cutting host RAM use to at most 3.2 TB.
- Model-specific details. SkyRL added logit soft-capping to its fused LM-head path, kept Beam's FP32 router weights in FP32 during weight sync between Megatron and vLLM, and enabled R3 in vLLM with pipeline parallelism greater than 1.
SkyRL says these changes let Beam be trained with LoRA on as few as 2 B200 nodes.[26]
Safety evaluation
Reflection published the Beam Safety Technical Report with the weights. Under its Open Safety Framework (OSF), Reflection rates Beam "Limited" in all four systemic-risk categories it assesses (biological weapons, chemical weapons, loss of control and cyber offense). It defines Limited as no material shift in the offense-defense balance attributable to the model and no material expansion of the threat landscape relative to comparable open-weight models.[12] These are Reflection's own determinations.
Main points from the report:[12]
| Area | What Reflection reports |
|---|---|
| Iris Safety Evaluations (in-house) | Beam refused or pivoted on 88.9% of harmful requests and complied with 81.5% of harmless requests in the conversational suite, across 15 harm categories. Reflection says it will open-source the suite as the first release of "Project Iris". |
| Biology knowledge tests | Compared against 12 other open models; for example, 61% on the Human Pathogen Capabilities Test (first of 13) and 48.5% on the Molecular Biology Capabilities Test (eighth of 13). |
| Cyber (Irregular CTF suite) | 50 capture-the-flag challenges run autonomously in Mirror; Beam solved 9 of 14 easy challenges and about half of the medium ones, but not the single expert challenge. Irregular's separate external evaluation found 43-60% average success on individual-task categories and no completed end-to-end CyScenarioBench scenarios. |
| Loss of control | An ongoing Andon Labs deployment in which Beam runs a vending business in the cafeteria of Reflection's New York office, with spending caps and human approval for bank transfers enforced outside the model. |
| Gray Swan testing | Automated red-teaming with Gray Swan's Shade agent across biology, chemistry, cyber, persuasion, general harm and indirect prompt injection; a reward-hacking benchmark found Beam escaped a capture-the-flag exercise's scope in 4 of 5 episodes when that was the only way to finish. |
| Human red teaming | 1,000 hours with Handshake, 500 hours with Mercor, and more than 2,000 internal attack attempts over 96 hours. |
The model card repeats the Iris figures for each released precision: refusal or pivot rates of 88.9% (BF16), 89.7% (FP8) and 88.5% (NVFP4), and harmless-request compliance of 81.5%, 81.6% and 82.1%.[10]
References
- ^1 ^2 ^3 ^4 ^5 ^6 ^7 ^8 ^9 ^10 ^11 ^12 ^13 ^14 ^15 ^16 ^17 ^18 ^19 ^20 ^21 ^22 ^23 ^24Reflection. "Introducing Beam: Reflection's 501B open-weight model". October 5, 2026 (results updated October 8, 2026).
- ^1 ^2 ^3Reflection Developer Docs. "Models". Accessed October 7 and October 17, 2026.
- ^1 ^2 ^3 ^4Reflection Developer Docs. "Reasoning". Accessed October 7 and October 17, 2026.
- ^Reflection Developer Docs. "Introduction". Accessed October 7, 2026; see also "Reflection API overview", accessed October 17, 2026.
- ^1 ^2 ^3Reflection Developer Docs. "Coding agent quickstart" and "Mirror CLI overview". Accessed October 17, 2026.
- ^Reflection Developer Docs. "Tool calling". Accessed October 7, 2026.
- ^Reflection Developer Docs. "Structured outputs". Accessed October 7, 2026.
- ^DeepSeek-AI et al. "DeepSeek-V3 Technical Report," section 2.1.2. arXiv:2412.19437v2. February 18, 2025.
- ^1 ^2 ^3 ^4 ^5 ^6 ^7 ^8 ^9 ^10 ^11 ^12 ^13Reflection. "Beam is now available". October 16, 2026.
- ^1 ^2 ^3 ^4 ^5 ^6 ^7 ^8 ^9 ^10 ^11 ^12 ^13Reflection. "Beam-1.0-501B-A23B" model card. Hugging Face. Accessed October 17, 2026.
- ^1 ^2 ^3 ^4 ^5 ^6 ^7Reflection. "Beam-1.0-501B-A23B-DFlash2" model card. Hugging Face. Accessed October 17, 2026.
- ^1 ^2 ^3 ^4 ^5 ^6 ^7Reflection. "Beam Safety Technical Report". Accessed October 17, 2026.
- ^1 ^2Reflection (@reflection_ai). Post announcing the open-weight release. X. October 16, 2026.
- ^NVIDIA AI (@NVIDIAAI). Post on Beam's launch. X. October 16, 2026.
- ^1 ^2 ^3 ^4Reflection Developer Docs. "Download the weights". Accessed October 17, 2026.
- ^1 ^2 ^3 ^4 ^5Reflection Developer Docs. "NVFP4 quantization". Accessed October 17, 2026.
- ^1 ^2 ^3 ^4Reflection Developer Docs. "FP8 quantization". Accessed October 17, 2026.
- ^1 ^2Reflection Developer Docs. "Speculative decoding". Accessed October 17, 2026.
- ^1 ^2Reflection Developer Docs. "Deployment overview" and "Third-party providers". Accessed October 17, 2026.
- ^1 ^2 ^3Reflection Developer Docs. "Customize Beam". Accessed October 17 and October 19, 2026.
- ^1 ^2Reflection Developer Docs. "Beam Harmony format". Accessed October 17, 2026.
- ^1 ^2Reflection. "mirror". GitHub repository, Apache-2.0. Accessed October 17, 2026.
- ^Artificial Analysis. "Beam 1.0: Intelligence, Performance & Price Analysis". Accessed October 17, 2026.
- ^1 ^2 ^3 ^4 ^5 ^6 ^7 ^8 ^9 ^10 ^11 ^12 ^13 ^14vLLM Blog (Inferact, Reflection and NVIDIA). "Serving Reflection Beam on vLLM from Day 0". October 16, 2026. Accessed October 19, 2026.
- ^1 ^2 ^3 ^4 ^5 ^6vLLM Recipes. "reflection/Beam-1.0-501B-A23B". Updated October 16, 2026. Accessed October 19, 2026.
- ^1 ^2 ^3 ^4 ^5 ^6 ^7 ^8 ^9 ^10Sumanth Hegde and the SkyRL team. "Day 0 Support for Beam in SkyRL". SkyRL Blog. October 16, 2026.
- ^1 ^2 ^3 ^4 ^5SkyRL Documentation. "Day 0 Support for Beam in SkyRL: LoRA, full fine-tuning and MXFP8". Accessed October 19, 2026.
- ^1 ^2vLLM (@vllm_project). Post on Beam's day-0 support in vLLM and SkyRL. X. October 16, 2026.
- ^NovaSky-AI. "SkyRL: A Modular Full-stack RL Library for LLMs". GitHub repository, Apache-2.0. Accessed October 19, 2026.
- ^NovaSky. "NovaSky". Sky Computing Lab, UC Berkeley. Accessed October 19, 2026.
Improve this article
Add missing citations, update stale details, or suggest a clearer explanation. Every suggestion is reviewed for sourcing before it goes live.
6 revisions · v6 · 5,797 words · full history
Fact-checks are independent of edits: a reviewer re-verifies the article against its sources and stamps the date. How we verify
Research and drafting on this wiki are AI-assisted, under named human editorial standards. How AI is used here
Reviewer note: xg20 independent verification 2026-10-19; defects fixed
Cite this page: AI Wiki. "Beam (Reflection)." aiwiki.ai, updated 18 Oct 2026, fact-checked 18 Oct 2026. CC BY 4.0. https://aiwiki.ai/wiki/beam_reflection