Many hyperlinks are disabled.
Use anonymous login
to enable hyperlinks.
Check-ins with non-propagating tags:
|
2026-09-17
| ||
| 02:49 |
Vocab 65->97: 32 filler tokens, V_GROUPS 3->4, geometry sync guard
Phase B of the vocab-ceiling edition: pads the vocabulary with 32 synthetic filler tokens (xxq01..xxq32, no training pairs) so the generalized head machinery runs at V_GROUPS=4 / 16 output probes, with zero-padded tail-group lanes exercising the group-3 path. - corpus.rs: VOCAB_FILLERS; build_vocab() includes them - consts.rs: V=97 (V_GROUPS/N_LOGITS/traces all derive automatically) - llm_common.h: sync C++ V mirror with consts.rs (was 65) - llm_kernel.cpp: llmfog_expected_vocab_size() FFI - backend.rs: assert_kernel_geometry() on every encrypt/server_run/ decrypt path — one-sided V bumps now fail loudly instead of silently cross-shifting logit groups - twin.rs: re-save checkpoint on the perfect-convergence break (the best-eval-only save kept a stale checkpoint that mis-decoded germany->tokyo); twin retrained from scratch at V=97 - data/, twin/model-rs.safetensors: re-exported artifacts Gates at V=97: build --locked; cpu MATCH on all 16 output cts (16 probes logit0..15, trace cache key groups_4, 168,265 instr); check MATCH everywhere incl. filler lanes (~2e-8); sim PASS; sweep 6/6 + tripwire clean; activations inside band (resid 18.3, logits 88.4). Decode unchanged: paris on the capital-of-france prompt. Full record in design/VOCAB_SCALE.md (Phase B section). leaf check-in: 99b39c8f93 user: andrew tags: closed, vocab-scale | |