Wenzhang DuOpen Research Reports ↗

Representation geometry · v1.0.1

Compare two ways to observe an embedding

Two sets of 23 observations see the same pairwise overlap pattern. Following the identity of the shared city changes how well they reconstruct a held-out directory.

Atomic sentences

Both plans observe 23 of 64 states. Lower normalized mean squared error indicates a closer reconstruction.

Star23 / Cycle23 · NMSE
0.01238 / 0.02657
Relative error reduction
53.39%
Balanced nDCG@5 · Star23 / Cycle23
0.29019 / 0.28975
Paired test worlds
2,048
Star23 · exact-state retrieval 99.02%
Cycle23 · exact-state retrieval 96.00%

The study concerns a finite synthetic directory and fixed encoders. Qwen uses a preselected subset of the original test pool.