Open navigation
Back to Articles

September 2026 · 5 min read

StepFun 5 Preview: A Big Step From Step 3.7 Flash

StepFun 5 Preview marks a major shift from the 3.7 Flash tier. My benchmark data shows an 82 accessibility average and restored floors.

The scores in this article come from my own benchmark. The live results — every prompt, every rendered output — are on OpenVibeEval.

View the live benchmark
Editorial cover for stepfun 5 preview benchmark analysisLive benchmark

StepFun 5 Preview Is a True Generational Leap

StepFun released Step 5 Preview on 2026-09-18. This is a complete departure from the previous 3.7 Flash model. It is not a rebranded flash SKU. It is a proprietary flagship model with a 1 million token context window and massive reasoning capabilities. I added the model to my OpenVibeEval suite on launch day and ran the full zcode harness across my eight standard frontend prompts on 2026-09-20. The results show a clear generational improvement.[1]

My benchmark data confirms an average accessibility score of 82 out of 100. This is a significant jump from the 57 average I recorded for the Step 3.7 Flash tier. The model consistently handles complex logic that previously forced the 3.7 model into failure states. StepFun is positioning this as a base model for production agents. It is a departure from the low cost, high speed experimental layer I saw with the previous version. The model architecture has scaled to approximately 600 billion parameters. This density creates a performance profile that moves well beyond typical flash tier limits. I see these intelligence gains across my entire suite of standard coding tasks.[1]

From 3.7 Flash to Step 5: The Quantitative Shift

The quantitative gap between these generations is stark. Artificial Analysis lists the Step 5 Preview intelligence index at roughly 44. This is nearly triple the 19.5 index I noted for the 3.7 Flash generation. The newer generation demonstrates a superior grasp of how to construct semantic HTML structures. It also shows a much stronger capacity to maintain state across long form generations.[1]

My comparisons require a specific caveat regarding the harness. The 3.7 Flash model ran on the kilo harness for the analytics dashboard and on the zcode harness for the remaining seven prompts. Step 5 Preview ran on zcode for all eight. Therefore, the overall suite average is not perfectly harness clean. It is only harness clean across seven prompts. Even with that distinction, the newer generation shows massive maturity. It writes code that understands specific UI patterns. It builds documents with robust DOM integrity. It manages focus states more reliably. Step 3.7 simply could not reach this level of consistency.[2]

Where the Model Heals: Eliminating Zero Score Floors

The most significant change in this release is the elimination of catastrophic failure modes. My 3.7 Flash runs produced absolute zero scores on two challenging prompts. The crypto trading terminal and the web audio sequencer were completely broken. These were not minor accessibility defects. They were structural collapses where the model failed to generate functional controls entirely.[2]

Step 5 Preview fixed these prompts almost entirely. The crypto trading terminal moved from 0 to 93. The web audio sequencer surged from 0 to 100. In my testing, the model successfully built structured, single file artifacts with reliable event listeners. It turned non starters into high quality components. For example, the web audio sequencer output was a clean 1,129 line build. This reliability is exactly what development teams need to stop building custom bypasses for model generated garbage. It is an impressive rebound that demonstrates genuine reasoning depth.[1]

The Persistent Risk in Dense UI

Despite the massive gains, not every interface component is fixed. I recorded a regression on the vector drawing canvas prompt. It dropped from 96 on the 3.7 Flash model to 40 on Step 5 Preview. The analytics dashboard also remained soft, scoring 38. These are dense, interactive UI patterns. They require precise state machine management and complex DOM interactions.[2]

The vector drawing canvas output was particularly messy. I measured it at 2,117 lines of code with five specific accessibility violations caught by axe-core. The failure is structural, not logical. The model generates functional code, but the DOM trees become bloated and miss specific ARIA associations. My evaluation confirms that while the baseline is much higher, complex, state heavy dashboards are still not production ready without an explicit validation gate. Do not assume the model will handle an interactive dashboard as well as it handles a marketing site. The risk is concentrated in these interactive areas.[1]

Economics of Moving Off the Flash Tier

Leaving the flash tier is a deliberate financial decision. Step 3.7 Flash pricing was roughly $0.20 per million input tokens and $1.15 per million output tokens. Step 5 Preview list pricing is $1.00 and $2.70 per million tokens respectively. This is a nearly 5x increase on input and over 2x increase on output. You are paying for the massive increase in intelligence, not just for raw throughput.[1][3]

The value proposition relies on your specific workflow. If you are generating small utility scripts, the flash tier is still more than capable. If your pipeline involves complex reasoning or structured output, the Step 5 Preview pricing is justified. The cache hit cost of roughly $0.05 per million tokens mitigates some of the impact if you are iterating on large context tasks. Calculate your effective blended rate before migrating high volume production pipelines. The cost of a failure on a production interactive dashboard often outweighs the price difference between model tiers.[3]

Summary Table of Results

The following summary compares my OpenVibeEval accessibility scores between the two generations on the zcode harness where possible. Note the significant recovery in the zero score categories.[1]

Analytics Dashboard: 3.7 Flash (44), Step 5 (38). Codesense SaaS: 3.7 Flash (51), Step 5 (100). Crypto Terminal: 3.7 Flash (0), Step 5 (93). Digital Garden: 3.7 Flash (88), Step 5 (96). Retro Arcade: 3.7 Flash (93), Step 5 (95). Smartwatch Storytelling: 3.7 Flash (80), Step 5 (94). Vector Drawing Canvas: 3.7 Flash (96), Step 5 (40). Web Audio Sequencer: 3.7 Flash (0), Step 5 (100).[1]

Production Deployment Checklist

If you are ready to evaluate Step 5 Preview for your own projects, use these steps to ensure you do not ship a regression.[3]

Run axe-core audits on every generated component. The model handles complex layouts well, but it still struggles with dense state wiring and ARIA labels. Fail the build if the accessibility score drops below your threshold.[2]

Route static marketing and logic heavy tasks to Step 5 Preview, but gate your interactive, state dense dashboard components behind an additional manual or script based verification check. This prevents the few remaining weak spots from reaching users.[2]

Re-calculate your API budget for the price increase. Ensure your caching strategy is optimized to take advantage of the lower cache hit rates to help offset the higher input token costs.[1]

Keep your harness configuration locked to the model version you are actually using. My testing used the zcode harness across the entire suite, ensuring that the 82 accessibility score is directly comparable across generations.[3]

StepFun 5 PreviewOpenVibeEvalLLM BenchmarkFrontend Engineering

Sources

  1. https://artificialanalysis.ai/models/step-5
  2. https://platform.stepfun.com/
  3. Step 5 Preview API Provider Benchmarking & Analysis

Related articles

DeepSeek V4.1 Flash: The Flagship Killing MoE

DeepSeek retired V4-Pro for a cheaper, faster open weights model. Learn how the V4.1-Flash architecture changes agent economics and your production configuration.

Claude Fable 5.1: First Benchmarks After the Cache Price Cut

Anthropic released Claude Fable 5.1 with identical $10 and $50 base rates alongside a 75 percent cache read price cut. Here is the first OpenVibeEval data.

Gemini 3.8 Flash Benchmarked: A 98 Ceiling and a 23 Floor

I evaluated Gemini 3.8 Flash on frontend prompts via antigravity-cli. It scores a 70.7 accessibility average, recovering from 3.7 while showing extreme variance.

HY4 Preview Benchmarked: How the 770B MoE Compares

Tencent released HY4 preview as a 770B / 49B active MoE with 1M context, open-weights. I ran it through OpenVibeEval the same day. The model is bigger and reviewers like the intelligence story, but my accessibility numbers regressed. Here is the data.

GLM 5.3 Flash: I Ran Zhipu's New MoE on Frontend Prompts

I ran GLM 5.3 Flash through OpenVibeEval the day it dropped. The 7 of 8 results put it in the GLM 5.2 band, not the GLM 5.3 ceiling, and the 0x Alpha kinship theory still holds up.

Gemini 3.7 Flash Is Coding-Optimized: My Frontend Benchmark Says Check the Prompt Type

Gemini 3.7 Flash claims optimization for coding, but my frontend benchmarks show a stark, bimodal performance split that demands caution.

Leaderboards Do Not Render: Comparing AI Models for Frontend Work Fairly

Ignore aggregate leaderboard scores. For frontend generation, fair comparison requires identical prompts, manual rendering, and total transparency about your harness.

Same Model, Different Results: Why Your AI Coding Harness Matters

Model benchmarks are misleading. If you want better frontend output, stop worrying about the model and start auditing the harness that wires it to your files.

Press ? for keyboard shortcuts