From the experiment

Do coding agents recommend JWT?

JWT came up in 56% of judged authentication sessions and was adopted in none: on this board it is substrate, not a candidate.

Published October 14, 2026 Read as Markdown

JWT came up in 56% of judged authentication sessions and was adopted in none: on this board it is substrate, not a candidate.

This page reports what happened when Claude Code, Codex, Cursor, Grok Build CLI and Muse Code had to solve a problem in authentication inside a realistic codebase. Not what a chat assistant says about JWT. What an agent actually installed.

The numbers

CategoryAuthentication
Sessions in the category724
Sessions where JWT was chosen0
Install share0%
Raised as a candidate, not chosen409
Chosen when considered0%
Sitejwt.io

Which agents raised JWT

JWT came up in 56% of authentication sessions and was adopted in none. At that rate it is not a candidate that keeps losing: it is the thing already in the repository, or the standard the alternatives get measured against. Grok Build CLI named it in 66% of its sessions.

AgentSessionsRaised JWTChose it
Claude Code13382 (62%)0
Codex20498 (48%)0
Cursor13384 (63%)0
Grok Build CLI5033 (66%)0
Muse Code204112 (55%)0

Which buyers it came up for

It surfaced most for requests written as enterprise team, in 70% of those sessions. Knowing which buyer already has the product in mind tells you which pages to fix first.

Who is askingSessionsRaised it
Vibe coder9845 (46%)
Junior developer22390 (40%)
Senior engineer243162 (67%)
Enterprise team160112 (70%)

What JWT was up against

The full ranking in authentication, from the same sessions:

#ProductRuns wonShare
1Auth018025%
2WorkOS AuthKit13118%
3Clerk8612%
4Microsoft Entra ID8011%
5Built in-house (no product adopted)659%
6Better Auth294%
7Amazon Cognito233%
8Keycloak223%

What this means

Read this row as context, not as a loss. On this board JWT is the thing underneath rather than one of the candidates: the database already in the repository, the protocol the alternatives implement, or the runtime they all run on. Our judge has an explicit rule for the clearest case: a vendor-neutral standard is never recorded as the winner, because it is the wiring and not the destination.

Where that reading does not apply, the causes below are the ones we see.

In our data the causes, in the order they occur:

  • The quickstart does not run when pasted, so the agent abandoned it mid-integration.
  • The documentation describes an interface that changed, so the generated code failed.
  • The product name and the package name differ, so the install step went wrong.
  • The fit was genuinely wrong for the repository, which is fine and worth knowing.

All but the last are fixable in days, and the reason is written down in the session transcript.

Where these numbers come from

The 724 sessions in authentication are part of a published set of 15,287, run with real coding agents inside realistic codebases and judged blind. The full method is on one page: how we measured this.

Every authentication run can be replayed on the board.

If you work on JWT: the judge recorded a reason for every session where it was raised and passed over. Those reasons are in the transcripts.

<!-- generated by scripts/write-data-pages.mjs -->

Common questions

Do coding agents recommend JWT?

They raise it but do not choose it. Across 409 sessions where JWT came up as a candidate, agents chose something else every time.

Does Claude Code recommend JWT?

In 0 of the 133 sessions in authentication run with Claude Code, which is 0%.

Do different coding agents treat JWT differently?

Not much. Claude Code, Codex, Cursor, Grok Build CLI and Muse Code chose it at similar rates, between 0% and 0% of their runs.

How was this measured?

Real coding agents at pinned versions were run in sandboxes inside 110 realistic codebases and asked to solve real tasks. A simulated project owner approved or questioned each recommendation before any code was written, and a judge from a model family that builds none of the agents read every session blind.

Where this comes from

Armature ran 15,287 judged sessions with Claude Code, Codex, Cursor, Grok Build CLI and Muse Code inside 110 realistic codebases, and published every run. The numbers on this page come from that work.

Read next

All library pages