Skip to content

Name the row GLM-5.3-Flash (preview) and footnote what it was queried as - #170

Merged
MaxGhenis merged 1 commit into
mainfrom
glm-flash-label
Sep 6, 2026
Merged

Name the row GLM-5.3-Flash (preview) and footnote what it was queried as#170
MaxGhenis merged 1 commit into
mainfrom
glm-flash-label

Conversation

@MaxGhenis

Copy link
Copy Markdown
Contributor

Summary

Per the owner: the preview row is named for the model Z.ai disclosed, with a footnote on what it was queried as.

  • Label everywhere (leaderboard, model page, explorer headers via shortModelLabel, paper tables): GLM-5.3-Flash (preview). It keeps "preview" because no source states that the checkpoint that answered equals the released model, and it is distinct from the GLM-5.3 row.
  • New MODEL_PROVENANCE_NOTES in app/src/modelMeta.ts: "Queried as "Ox Alpha", OpenRouter's stealth listing of 2026-08-20; Z.ai identified it as GLM-5.3-Flash after the run …". Rendered under the model page title and as the leaderboard row's title.
  • Paper prose and the serving-configuration caption restated; sensitivity/ox-alpha-2026-08.md retitled. The artifact key stays ox-alpha (it is baked into the frozen predictions, annotations and manifest hashes).
  • Paper re-rendered and re-pinned; no score or data change.

Tests

tests/test_paper_results.py pins the display name; app/tests/modelMeta.test.ts pins the label, the note's content and that every note keys a real model; shortModelLabel("GLM-5.3-Flash (preview)") is "GLM-5.3-Flash". Lint, 126 app tests and the paper-results tests pass.

🤖 Generated with Claude Code

The label now leads with the model Z.ai disclosed and keeps the preview
qualifier; a provenance note (MODEL_PROVENANCE_NOTES) records that it
was queried as OpenRouter's stealth listing "Ox Alpha" on 2026-08-20 and
that checkpoint equality with the released model has not been stated.
The note shows on the model page under the title and as the leaderboard
row's title; the paper's prose and serving-configuration caption say the
same and the artifact key stays ox-alpha. Paper re-rendered and re-pinned;
no score or data change.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
@vercel

vercel Bot commented Sep 6, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
policybench-site Ready Ready Preview Sep 6, 2026 12:52pm UTC

Request Review

@MaxGhenis
MaxGhenis merged commit 269c22f into main Sep 6, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant