Power Your Software Testing with AI Agents and Cloud
The Native AI-Agentic Cloud Platform to Supercharge Quality Engineering. Test Intelligently and Ship Faster.
- TestMu AI (Formerly LambdaTest)
- /
- Blog
- /
- DeepSeek V4.1 Flash 1017: Benchmarks, Pricing and Setup
DeepSeek V4.1 Flash 1017: Benchmarks, Pricing and Setup
DeepSeek V4.1 Flash 1017 now serves every deepseek-flash API call. See its benchmarks, pricing, Search and Fetch APIs, and what to retest before you rely on it.
Published on:
Every request to the deepseek-flash model ID now runs on a new checkpoint, DeepSeek-V4.1-Flash-1017, and nothing in your configuration had to change for that to happen. DeepSeek's change log says the update scores higher across its benchmark set, lifting Terminal-Bench 4.0 from 31.2 to 42.3, while it finishes tasks faster and writes shorter outputs, with the API call and pricing unchanged.
Shorter outputs and faster runs are what DeepSeek is selling, and they can also shift an agent you already tuned: a support answer that drops a step, or a tool loop that ends one call early. I build agentic AI capabilities at TestMu AI, and a checkpoint swap behind a stable model ID gets the same regression pass there as a code change.
TL;DR
DeepSeek-V4.1-Flash-1017 is the October 17, 2026 update to DeepSeek's V4.1-Flash model, now served under the deepseek-flash API ID at unchanged prices. It exists to raise agentic and coding scores while cutting task time and output length, and its MIT-licensed weights are on Hugging Face and ModelScope.
- Model ID: Which model does deepseek-flash point to now? DeepSeek-V4.1-Flash-1017. The retired deepseek-v4-flash and deepseek-v4-flash-vision-exp names route to it too, and the DeepSeek API no longer serves the September V4.1-Flash checkpoint.
- DeepSWE v1.1: DeepSeek-V4.1-Flash-1017 scores 77.0 on DeepSWE v1.1 in DeepSeek's model card, the top result in its comparison table, ahead of Claude Opus 5 at 74.0 and the September V4.1-Flash at 74.2.
- Claude Opus 5: Is DeepSeek V4.1 Flash better than Claude Opus 5? Not across the board. Claude Opus 5 leads six of the 11 rows in DeepSeek's own table, including HLE at 56.3 against 42.6 and Terminal-Bench 4.0 at 51.8 against 42.3.
- API pricing: How much does DeepSeek V4.1 Flash cost? Off-peak, deepseek-flash costs $0.15 per million cache-miss input tokens, $0.003 per million cache-hit input tokens and $0.60 per million output tokens. Peak-hour rates are double.
- Open weights: Is DeepSeek V4.1 Flash open source? Yes. DeepSeek-V4.1-Flash-1017 ships under the MIT license on Hugging Face and ModelScope, without a Jinja chat template, so self-hosters format prompts with DeepSeek's encoding reference.
- Vision: Does DeepSeek V4.1 Flash have vision? Yes. DeepSeek's pricing page lists vision as supported on deepseek-flash and not supported on deepseek-v4-pro.
- Search and Fetch APIs: DeepSeek opened its Search and Fetch APIs at $0.75 per 1,000 successful calls each. Calls made through DeepSeek Harness, Claude Code or Codex stay free until October 31, 2026, at 16:00 UTC.
- Agent Testing: TestMu AI Agent Testing reruns a chat agent's scenario suite after a model update, such as the move to DeepSeek-V4.1-Flash-1017, and scores Completeness, which flags replies that address the question but leave out what the user needs to act.
What Is DeepSeek V4.1 Flash 1017?
DeepSeek-V4.1-Flash-1017 is the newest version of DeepSeek's V4.1-Flash model, and it is live on DeepSeek's website, app and API. The release note calls it a Pareto improvement in performance and cost, and says the model is optimized for DeepSeek Harness, Tencent CodeBuddy and WorkBuddy.
DeepSeek announced the release on X:
🚀 DeepSeek-V4.1-Flash-1017 is here!
- DeepSeek (@deepseek_ai) October 17, 2026
Now live on our website, app, and API. pic.twitter.com/MiqGbnCiVz
The update builds on the architecture DeepSeek introduced on September 10, 2026. Its V4.1-Flash release note describes a 552B-parameter mixture-of-experts model with a causal encoder-decoder design that activates 8B parameters for input and 16B for output, and a KV cache that needs a quarter of the HBM and an eighth of the SSD storage of the previous generation.
DeepSeek's models and pricing page lists what the API serves under the deepseek-flash ID:
| Attribute | deepseek-flash |
|---|---|
| Model version | DeepSeek-V4.1-Flash-1017 |
| API formats | OpenAI format at https://api.deepseek.com, Anthropic format at https://api.deepseek.com/anthropic, and the Responses API |
| Context length | 1M tokens |
| Maximum output | 384K tokens |
| Thinking mode | Thinking (the default) and non-thinking, with low, high and max effort |
| Vision | Supported (deepseek-v4-pro does not support it) |
| Tool calls and JSON output | Supported |
| FIM completion (beta) | Non-thinking mode only |
| Concurrency limit | 2,500 (deepseek-v4-pro: 500) |
| Weights and license | MIT, on Hugging Face and ModelScope |
How Does DeepSeek V4.1 Flash 1017 Score on Benchmarks?
DeepSeek's model card compares DeepSeek-V4.1-Flash-1017 with DeepSeek-V4.1-Flash and four other models: K3, GLM-5.3, GPT-5.6 Sol and Opus 5.
K3 is Kimi K3 and Opus 5 is Claude Opus 5, as the version of the table in DeepSeek's post on X labels them. The scores are vendor-reported. In the table below, the September column is the previous V4.1-Flash checkpoint, and the last column is the best result among those four other models.
| Benchmark | V4.1-Flash-1017 | V4.1-Flash (September) | Change | Best of the other four |
|---|---|---|---|---|
| HLE (no tools) | 42.6 (44.0 text-only) | 36.8 (39.1 text-only) | +5.8 | 56.3 (Claude Opus 5) |
| Terminal-Bench 4.0 | 42.3 | 31.2 | +11.1 | 51.8 (Claude Opus 5) |
| DeepSWE v1.1 | 77.0 | 74.2 | +2.8 | 74.0 (Claude Opus 5) |
| ProgramBench | 29.1 | 20.3 | +8.8 | 37.0 (Claude Opus 5) |
| NL2Repo-Bench | 68.2 | 65.4 | +2.8 | 75.3 (Claude Opus 5) |
| Automation-Bench v1.0.6 | 60.5 | 54.8 | +5.7 | 50.3 (Claude Opus 5) |
| Agents' Last Exam | 35.4 | 31.8 | +3.6 | 28.6 (Claude Opus 5) |
| Apex Bench v1.1 | 72.1 | 64.6 | +7.5 | 65.8 (Claude Opus 5) |
| Chartography (with tools) | 83.0 | 78.9 | +4.1 | 84.0 (Claude Opus 5) |
| BabyVision (with tools) | 92.5 | 89.6 | +2.9 | 94.1 (Claude Opus 5) |
| ZeroBench-main (with tools) | 51.0 | 49.0 | +2.0 | 53.0 (GPT-5.6 Sol) |
The notes under the table and in the change log explain how the runs were set up, which decides how far the numbers carry over to your agent:
- Harnesses - Terminal-Bench 4.0 ran in the Claude Code harness and DeepSWE v1.1 in the Mini-SWE-V2 harness, so each score measures the model inside that harness, not the model on its own.
- HLE subset - The bracketed HLE figures are the text-only subset of the benchmark.
- ZeroBench-main - This row is scored Pass@5, so the model gets five attempts per item.
- Comparison set - The table stops at Claude Opus 5 and GPT-5.6 Sol, and leaves out newer models such as Claude Opus 5.5.
Which rows matter depends on the work your agent does:
- Issue fixing and automations - The 1017 checkpoint posts the top score in the table on DeepSWE v1.1, Automation-Bench v1.0.6, Agents' Last Exam and Apex Bench v1.1, the rows closest to an agent working through tickets and multi-step workflows.
- Terminal and from-scratch repository work - Claude Opus 5 leads Terminal-Bench 4.0 by 9.5 points, ProgramBench by 7.9 and NL2Repo-Bench by 7.1, so long shell sessions and building a repository from a spec still favor it. For a wider shortlist, see the best LLM for coding.
- Reasoning without tools - The widest gap in the table is HLE, where Claude Opus 5 scores 13.7 points higher.
- Visual tasks - Claude Opus 5 leads Chartography by 1.0 point and BabyVision by 1.6, and GPT-5.6 Sol leads ZeroBench-main by 2.0.
- Gains over September - Terminal-Bench 4.0 rose 11.1 points and ProgramBench 8.8, the two largest jumps, so terminal-heavy agents are where a retest is most likely to show a change.
- Cost per task - The release note adds a DeepSWE v1.1 chart of Pass@1 against average cost per task, which plots the 1017 checkpoint's max-effort run above and to the left of the September checkpoint's max-effort run: a higher score at a lower cost.
Note: DeepSeek's scores come from its own harness runs, not from your prompts, tools or users. TestMu AI Agent Testing generates test scenarios from your agent's own documents, including adversarial and persona-specific cases, so you can compare checkpoints on the conversations your agent actually handles. Create a free account
How Much Does DeepSeek V4.1 Flash 1017 Cost on the API?
DeepSeek bills deepseek-flash per million tokens, at peak and off-peak rates, and the 1017 update left those rates unchanged. The models and pricing page lists them next to deepseek-v4-pro:
| Per 1M tokens | deepseek-flash, off-peak | deepseek-flash, peak | deepseek-v4-pro, off-peak | deepseek-v4-pro, peak |
|---|---|---|---|---|
| Input, cache hit | $0.003 | $0.006 | $0.022 | $0.044 |
| Input, cache miss | $0.15 | $0.30 | $0.66 | $1.32 |
| Output | $0.60 | $1.20 | $1.98 | $3.96 |
- Peak hours - 01:00 to 04:00 and 06:00 to 10:00 UTC, Monday through Friday, excluding Chinese public holidays. Every other hour, including weekends and those holidays in full, bills at the off-peak rate, which is half the peak rate.
- Cache hits - A cache-hit input token costs one-fiftieth of a cache-miss token on deepseek-flash, so an agent that resends the same system prompt and tool definitions every turn pays mostly the cache-hit rate on that repeated prefix.
- Legacy model names - Requests that still name deepseek-v4-flash or deepseek-v4-flash-vision-exp are served by the 1017 checkpoint and billed at the Flash price.
- Scheduling - Nightly evaluation suites and batch jobs that can wait should run off-peak, where every rate in the table is halved.
Search and Fetch API Pricing
The 1017 release note also opened DeepSeek's in-house search engine to everyone through two APIs, Search and Fetch.
The Search and Fetch guide prices both APIs at $0.75 per 1,000 successful requests, billed per request rather than by tokens or by the number of results. A request is billable only when it returns HTTP 200 with a result, so failed requests, empty searches and timeouts cost nothing.
- Search -
POST /v1/tools/searchtakes a query of 1 to 128 characters and a count of 1 to 50 results (default 10). Each result carries a title, URL, snippet, a summary of typically 600 to 800 characters written for a model, a rerank_score from 0 to 3 and an authority tier from 0 to 4. - Query operators - site:, -site:, exact phrases, excluded terms, lang:, after: and before: pass through to the search engine.
- Fetch -
POST /v1/tools/fetchtakes one URL and returns the page as Markdown. A 404 means no usable content came back, and a 403 means DeepSeek's security policy rejected the fetch. - Rate limits - Search and Fetch each allow 5 requests per second per account, counted across all of the account's API keys.
- Free period - Server-side Search and Fetch calls made through DeepSeek Harness, Claude Code and Codex are free until November 1, 2026, at 00:00 Beijing time (October 31 at 16:00 UTC).
If your coding agent's research step runs through Claude Code on DeepSeek, count its Search and Fetch calls per task from your traces now, while they are free, so the November bill holds no surprises.
How the DeepSeek API Handles Thinking, Effort and Model Names
Several request settings behave differently from what OpenAI- and Anthropic-style client code assumes.
The thinking mode guide documents the thinking defaults, how requested effort values map to the effort the model actually uses, and which sampling parameters take effect:
| Setting | What the DeepSeek API does |
|---|---|
| Thinking mode | On by default, at high effort. Turn it off with {"thinking": {"type": "disabled"}} in OpenAI format, or with reasoning effort none in the Responses API. |
| Effort values | Only low, high and max exist. minimal maps to low, medium and xhigh map to high, and ultra maps to max. |
| temperature and penalties | temperature, presence_penalty and frequency_penalty are accepted but have no effect in thinking mode, and no error is raised. |
| top_p on deepseek-flash | Applies only in thinking mode, where values below 0.95 are treated as 0.95. Non-thinking mode fixes it at 1.0. |
| reasoning_content with tools | When a request carries tools, the reasoning_content of every earlier turn must be passed back, even turns with no tool call. Leaving it out returns a 400 error. |
| reasoning_content without tools | Ignored if passed back, and not added to the context. |
On the Anthropic API endpoint, the model name you send decides which DeepSeek model runs and what you pay:
- claude-opus names - Map to deepseek-v4-pro and are billed at the V4 Pro price, not the Flash price.
- claude-sonnet and claude-haiku names - Map to deepseek-flash, which now means the 1017 checkpoint.
- Other unsupported names - A model name that is not a DeepSeek model and does not start with claude returns a 400 error.
- Ignored fields - Thinking budget_tokens, cache_control, mcp_servers, top_k and the anthropic-version header are accepted and ignored, and output_config supports only effort.
Check two things in your client before anything else: the effort value it sends, because xhigh runs at high, and any test that sets temperature to 0 expecting a repeatable answer, because thinking mode ignores it.
Self-Hosting the Open Weights
The release ships no Jinja chat template. The model card points instead to an encoding folder that holds a Python reference implementation, with test cases for multi-turn conversations, tool calls, thinking mode and interleaved images. It recommends temperature 1.0, top_p 1.0, the full 1M-token context window and max_tokens of at least 256K.
The encoding reference shows that the open model takes reasoning effort as a numeric budget from 1 to 100. The low, high and max aliases map to 50, 75 and 100, and high is the default.
deepseek-recipe is a set of Rust libraries with Python bindings that converts Messages, Chat Completions and Responses requests into DeepSeek's Conversation format, encodes them into DeepSeek V4 and V4.1 prompts or token IDs, and parses model output back into responses. It lists server tool execution, such as web_search, as not yet supported.
A self-hosted agent therefore needs its own search tool in place of the Search and Fetch tools DeepSeek runs server-side on its API.
Self-hosting is also how you keep the previous checkpoint, which the API no longer serves.
The DeepSeek-V4.1-Flash repository on Hugging Face hosts those weights under the MIT license.
How to Regression Test an Agent After the 1017 Update
A checkpoint swap under the same model ID is a change you did not deploy, so treat it like one: run the agent's existing suite against the new checkpoint and compare the results with the last run from before October 17. Agentic regression testing covers which of those checks to automate, and LLM testing covers the basics of scoring model output. Each row below traces to a line in DeepSeek's documentation:
| What DeepSeek's docs say | Test to run |
|---|---|
| deepseek-flash now serves the 1017 checkpoint, and the September checkpoint is no longer offered on the API | Rerun the full scenario suite and diff it against the last pre-update run. Failures that appear only now point at the model, not your code. |
| Outputs are shorter than the previous version | Check replies that must carry several steps, fields or caveats, and flag any that now stop short. |
| Tasks complete faster | Compare step and tool-call counts per task. An agent that now finishes in fewer calls may be skipping a check it used to run. |
| xhigh maps to high, and ultra maps to max | Run every test at the exact effort value your production client sends. |
| temperature has no effect in thinking mode | Score each scenario over several runs instead of expecting one fixed answer at temperature 0. |
| reasoning_content must be passed back when tools are present | Add a multi-turn tool scenario that includes a turn with no tool call, and fail the run on any 400 error. |
| claude-opus names route to deepseek-v4-pro | Confirm which model your Claude-named requests reach, and check the billing line that goes with it. |
| Search and Fetch calls through harnesses become billable on November 1 | Count Search and Fetch calls per task in your traces and set a budget alert before billing starts. |
Checking Chat Agents for Shorter Answers
Shorter outputs lower a coding agent's token bill, and they can also cut a support agent's answer short. TestMu AI's Agent Testing is built for regression testing after model updates: it runs a chat agent's scenario suite through the same endpoint your users reach and scores every reply, so a run on the 1017 checkpoint can be set against the run before it.
- Completeness - Checks whether a reply fully addresses the user's need. A user who asks how to cancel and gets the cancellation policy without the steps fails it, which is the failure shorter outputs make more likely.
- Hallucination and context awareness - Flags invented facts and details the agent forgets from earlier turns, two behaviors any checkpoint change can move.
- Go or no-go verdict - Each run ends in Green, Yellow or Red with a confidence level, so the model swap gets a release decision instead of a folder of transcripts.
- Endpoint profiles - A saved REST, WebSocket, SSE or polling profile defines how the platform reaches your agent, so the same suite reruns unchanged whenever the model underneath it changes.
How to Use DeepSeek V4.1 Flash 1017 in a Coding Agent
The release note says the 1017 checkpoint uses reinforcement learning with self-feedback to improve end-to-end project development, and shows it building a web-based racing game, a 3D model of the Forbidden City and a Portal 2 recreation in the Godot engine. It recommends DeepSeek Harness v0.2.1-rc.1 or later for the best experience with the new model.
DeepSeek Harness, DeepSeek's own agent harness, added support for DeepSeek-V4.1-Flash-1017 in dsh-v0.2.1-rc.2, along with the DeepSeek Search and Fetch APIs, which you turn on in its Web Search settings.
For Claude Code, DeepSeek's integration guide sets ANTHROPIC_BASE_URL to DeepSeek's Anthropic endpoint, sets ANTHROPIC_MODEL and the default Opus and Sonnet models to deepseek-flash[1m], and sets the Haiku and subagent models to deepseek-flash:
export ANTHROPIC_BASE_URL=https://api.deepseek.com/anthropic
export ANTHROPIC_AUTH_TOKEN=<your DeepSeek API key>
export ANTHROPIC_MODEL=deepseek-flash[1m]
export ANTHROPIC_DEFAULT_OPUS_MODEL=deepseek-flash[1m]
export ANTHROPIC_DEFAULT_SONNET_MODEL=deepseek-flash[1m]
export ANTHROPIC_DEFAULT_HAIKU_MODEL=deepseek-flash
export CLAUDE_CODE_SUBAGENT_MODEL=deepseek-flash
export CLAUDE_CODE_EFFORT_LEVEL=max
export CLAUDE_CODE_AUTO_COMPACT_WINDOW=786432Keep the ANTHROPIC_DEFAULT_OPUS_MODEL line. Without it, Claude Code's Opus slot sends a claude-opus model name, which DeepSeek routes to deepseek-v4-pro at the V4 Pro price.
DeepSeek's demos are browser games and 3D scenes, and a coding agent that builds one can compile it, lint it and pass its unit tests without ever opening the page. Kane CLI runs a plain-English objective in a real Chrome browser and returns an evidence-backed pass or fail, so the agent can check the rendered result before it reports the task done:
npm install -g @testmuai/kane-cli
npx @testmuai/kane-cli-skill
kane-cli run "Open http://localhost:5173, click Start Race, and verify that the lap timer starts counting and the car is visible on the track" --agent --headlessThe skill installer adds Kane CLI to Claude Code, Codex CLI and Gemini CLI in one command, and the guide to Kane CLI with AI coding agents covers the other builders. With --agent, every run streams one JSON event per line and ends with a run_end event holding the status, summary and log paths, plus an evidence pack of screenshots, video and console logs the coding agent can read when a step fails.
How to Get Started With DeepSeek V4.1 Flash 1017
Pull your agent's last passing run from before October 17, rerun the same scenarios against deepseek-flash at the effort value you ship, and compare the two before you send the agent new traffic. If replies keep their length and step counts look right, schedule the full suite for off-peak hours. The Agent Testing CLI docs show how to start that suite from CI with one command after every model change.
Author
Chaitanya Sharma is an AI Product Manager at TestMu AI, where he builds agentic AI capabilities focused on computer vision and multi-modality, moving testing beyond static script execution toward autonomous, agent-driven workflows. Before TestMu AI he shipped 135+ features at Sprinklr for a no-code community and website builder used by Fortune 500 enterprises including Dell, Samsung, and Polestar. At Policybazaar he led the zero-to-one launch of a digital lending and insurance marketplace embedded in Bahrain's dominant payments app, building a risk-intelligence engine that compressed loan-approval times by 80%. He explored machine learning and NLP through research at the University of Cambridge, and holds a B.Tech from Delhi Technological University.
Reviewer
Sirajuddin Khan is Vice President of Product Management at TestMu AI, where he drives the company's agentic AI product strategy, building a suite of autonomous agents that includes Agentic Browsers and Agentic Visual Testing and shifting the unit of work from test execution to autonomous outcomes. One of the company's earliest product leaders, he has owned the roadmap for the high-performance execution cloud and grew the cross-browser testing products from early adoption to market leadership. He brings over a decade of experience across SaaS, B2B, and eCommerce, with earlier product roles at Wydr and ShopClues, where his catalog and search work cut delivery SLAs and lifted seller activity. Sirajuddin holds an MBA in Information Technology from Sikkim Manipal University and a B.Tech in Computer Science Engineering from Maharshi Dayanand University.
DeepSeek V4.1 Flash FAQs
Did you find this page helpful?
More Related Blogs
TestMu AI forEnterprise
Get access to solutions built on Enterprise
grade security, privacy, & compliance
- Advanced access controls
- Advanced data retention rules
- Advanced Local Testing
- Premium Support options
- Early access to beta features
- Private Slack Channel
- Unlimited Manual Accessibility DevTools Tests






