Existing systems also isolate token hierarchy from conditional expert routing, treating structural sparsification and parameter expansion as disjoint mechanisms.
The authors sought to resolve these limitations by constructing a unified encoder in which hierarchical token grouping explicitly stores child supports, supplying a scale-aware token stream that guides conditional sparse experts across varied spatial and semantic demands.
To build this visual vocabulary, the researchers adapted byte-pair encoding from text processing to formulate a hierarchical visual tokenizer.
Following hierarchical tokenization, active visual tokens are routed to specialized visual experts within a mixture-of-experts contextual encoder.
The model maintains eight stored visual experts, each dedicated to distinct visual evidence: surface texture, boundaries, object interiors, scene backgrounds, and rare categories.