
The layer list
Each row is a layer:- Name — what you called it
- Parameters — how many parameters this layer owns
- Policies — how many policies are configured, with state breakdown
- Bucket count — typically 10000 for the project (configurable in Settings → Hashing)
Layer detail
Clicking a layer opens its detail page with two tabs: Parameters (parameters in the layer) and Policies (policies configured against those parameters).
Policies list
Each policy in the layer shows:- Name and key
- Kind (static / adaptive / adaptive per-entity / adaptive contextual)
- State (draft / running / paused / completed)
- Allocations and their current bucket ranges
- Whether a rollout is attached
- Recent exposure volume
Creating a policy
New policy opens the policy editor.
- Name — human-readable
- Key — stable identifier (used in warehouse-native assignment SQL to match)
- Kind — static or adaptive
- State — start in
draft, switch torunningwhen ready
Allocations
Add allocations — each is a (name, bucket range, parameter overrides) tuple.
Conditions (targeting)

eq, neq, gt, gte, lt, lte, in, nin, contains, regex — see Policies.
Common patterns:
locale in [en-US, en-GB]— English-speaking marketsplan neq free— paying customers onlyemail contains @yourcompany.com— internal users only
Eligible bucket range
For non-overlapping experiments in the same layer, set an eligible bucket range — the policy only applies to users whose layer bucket falls in that range. Two policies with[0–4999] and [5000–9999] ranges never see the same user.
Adaptive configuration
If you set Kind toadaptive, additional sections appear:

- Algorithm — Thompson Sampling, Epsilon-Greedy, UCB1, or Linear Contextual
- Goal event — pick from existing event definitions
- Goal type —
conversion_rate,sum, orcount - Min exposures before shift — prevents premature shifts on noisy early data
- Window size — how often the engine re-evaluates (5m, 15m, 60m, 6h, 24h)
- Max shift per update — caps how aggressively traffic can move
productId). For contextual bandits, expand Context logging and list the allowed context fields.
Rollouts
A policy can have a rollout configuration attached. Click Add rollout in the policy editor or on the policy detail page.
- Target percentage — usually 100
- Ramp — either continuous (
X% every Y minutes) or a schedule (list of{percentage, scheduledAt}steps) - Health checks — one or more metric conditions evaluated before each step
- On health violation —
pause,rollback_one_step,full_rollback, oralert_only
Policy detail
The policy detail page is where you read results.
- Overview — current state, exposure counts, top-line conversion rates per allocation
- Metrics — every metric attached to this policy with per-allocation results and significance
- Allocations — current bucket ranges (live for adaptive policies); manual override
- Conditions — targeting rules
- Activity — every change to this policy (links to the decision log)
Manual actions
From the policy detail page you can:- Pause / resume the policy
- Override allocations — manually adjust bucket ranges (useful for cutting traffic to a misbehaving variant)
- Promote an allocation — copy a winning allocation’s parameter overrides into the parameter defaults
- Duplicate the policy — useful for forking an experiment for a new segment
- Complete the policy — final state, stops being evaluated, preserves history
Tips
- Always start in
draft. Build out the allocations and conditions, then flip torunningwhen you’re ready. Switching state is fast; building a misconfigured running policy is a panic. - Use the eligible bucket range for non-overlapping experiments rather than separate layers. Layers are for parameters; ranges are for sub-segments of the same layer.
- Name allocations descriptively.
controlandtreatmentare conventional, butlow_price_5is more useful thantreatment_bsix months later.
Next steps
A/B testing
Walking through a static policy end-to-end.
Optimization
Adaptive algorithms, contextual bandits, per-entity bandits.
Rollouts
Progressive delivery with health gates.
Policy health
Diagnostics for running policies: SRM, freshness, guardrails.
Decision log
Audit trail of every policy change.