← Back to AI Insights
Gemini Executive Synthesis

Semble, an open-source code search tool for AI agents. It combines static Model2Vec embeddings (potion-code-16M) with BM25, fused via RRF, and reranked with code-aware signals. It runs on CPU without transformers.

Technical Positioning
A token-efficient, fast, and accurate alternative to grep+read for AI agents (Claude Code, Cursor, Codex, OpenCode) when searching large codebases. It claims 98% fewer tokens than grep+read and 99% retrieval quality of a 137M-parameter transformer, while being ~200x faster. It is zero-config, requiring no API keys, GPU, or external services.
SaaS Insight & Market Implications
Semble addresses a critical operational bottleneck in AI agent development for code interaction. High token costs and slow performance of traditional methods like grep+read severely limit agent utility on large codebases. Semble's 98% token reduction and 200x speed improvement offer a significant cost and efficiency advantage, enabling more practical and scalable agent deployments. Its CPU-only, zero-config architecture lowers adoption barriers, making advanced code search accessible without specialized hardware or cloud dependencies. This innovation accelerates the development and adoption of AI-powered developer tools, shifting focus from raw model size to efficient, localized retrieval mechanisms. The market demands cost-effective, performant solutions for integrating AI into developer workflows, a demand Semble directly meets.
Proprietary Technical Taxonomy
Model2Vec embeddings potion-code-16M BM25 RRF code-aware signals CPU transformers NDCG@10

Raw Developer Origin & Technical Request

Source Icon Hacker News May 18, 2026
Show HN: Semble – Code search for agents that uses 98% fewer tokens than grep

Hey HN! We (Stephan and Thomas) recently open-sourced Semble. We kept running into the same problem while using Claude Code on large codebases: when the agent can't find something directly, it falls back to grep, reading full files or launching subagents. This uses a lot of tokens, and often still misses the relevant code. There are existing tools for this, but they were either too slow to index on demand, needed API keys, or had poor retrieval quality.Semble is our solution for this. It combines static Model2Vec embeddings (using our latest static model: potion-code-16M) with BM25, fused via RRF and reranked with code-aware signals. Everything runs on CPU since there's no transformers involved. On our benchmark of ~1250 query/document pairs across 63 repos and 19 languages, it uses 98% fewer tokens than grep+read and reaches 99% of the retrieval quality of a 137M-parameter code-trained transformer, while being ~200x faster.Main features:- Token-efficient: 98% fewer tokens than grep+read- Fast: ~250ms to index a typical repo on our benchmark, ~1.5ms per query on CPU (very large repos may take longer)- Accurate: 0.854 NDCG@10, 99% of the best transformer setup we tested- MCP server: drop-in for Claude Code, Cursor, Codex, OpenCode- Zero config: no API keys, no GPU, no external servicesInstall in Claude Code with:
claude mcp add semble -s user -- uvx --from "semble[mcp]" sembleOr check our README for other installation instructions, benchmarks, and methodology:Semble: github.com/MinishLab/sembleB... github.com/MinishLab/semble/... huggingface.co/minishlab/potion-... us know if you have any feedback or questions!

Developer Debate & Comments

ind-igo • May 18, 2026
I've been skeptical of these semantic search tools. Not only are agents already great with grep, the problem imo is these search tools treat your specific code like a destination, but your codebase is actually a graph, and your agent needs more context around your search term in order to make changes.Luckily, graph traversal of your code has been solved for a long time, by LSP. But LSP is so extremely memory inefficient.I created cx[0] to strip away the bloat from LSP into a lightweight navigation tool for agents, using only tree-sitter. I never got around to sharing on HN but might be time for a post.[0] https://github.com/ind-igo/cx
gslepak • May 18, 2026
Does this support any language or is it limited to a specific set of languages?
aadishv • May 18, 2026
Seems like a cool idea so I decided to play with it a bit. The test I ran was in the browsercode (https://github.com/browser-use/browsercode) repo with the following prompt:"Answer this question by only using the `semble` CLI (docs below):> What tools does Browsercode provide to the agent other than the base OpenCode tools? Provide the exact schema for tool input and tool output and briefly summarize what they do and how they work---[the AGENTS.md snippet provided from https://github.com/MinishLab/semble#bash-integration]"And the equivalent for the non-Semble test:"Answer this question by only using the `rg` and `fd` CLIs:> What tools does Browsercode provide to the agent other than the base OpenCode tools? Provide the exact schema for tool input and tool output and briefly summarize what they do and how they work"In both cases, I used Pi with gpt-5.4 medium and a very minimal setup otherwise. (And yes, I did verify that either instance only used rg & fd, or only used semble.)Without Semble, it used 10.9% of the model context and used $0.144 of API credits (or, at least, that's what Pi reported - I used this with a Codex sub so cannot be sure). With Semble, it used 9.8% of the model context and $0.172 of API credits. The resulting responses were also about the same. Very close!I tried one more test in the OpenCode repo. The question was > Trace the path from 1) the OPENCODE_EXPERIMENTAL_EXA env var being set to to 1 to 2) the resulting effects in the system prompt or tool provided to the OpenCode agent.And I included the same instructions/docs as above. The non-Semble version was a bit more detailed -- it went into whether the tool call path invoked Exa based on whether Exa or Parallel was enabled for the web search provider -- but w.r.t. actually answering the question, both versions were accurate. The Semble version used 14.7% context / $0.282 API cost, while the non-Semble version used 19.0% / $0.352. Clearly a win for Semble for context efficiency, but note that the non-Semble version finished about twice as fast as the Semble version.Of course this is just me messing around. ymmv.
andai • May 18, 2026
Nice, this sounds great. I want to mention a related issue here, which is that on small codebases, Claude spends a lot of time looking for stuff when it could have just dumped the whole codebase into the context in one go and used very little tokens.I found a nice workaround which is that you can just dump the whole directory into context, as a startup hook. So then Claude skips the "fumble around blindly in the dark" portion of every task. (I've also seen a great project that worked on bigger repos where it'll give the model an outline with stubs, though I forget what it was called.)
esperent • May 18, 2026
I did some evals with pi and GPT 5.5. I tested RTK on / headroom on / both on / both off (all with the standard pi system instructions and no AGENTS.md).I forget the exact tests I used (a couple of the standard agent evals that people use, one python and one typescript because those are what I use).I don't claim it was an exhaustive test, or even a good one. It's possible I could have spent a day or so tuning my AGENTS.md and the pi system prompt/tool instructions and gotten better results, because if there's one thing running evals taught me it's that subtle differences there can change the results a lot.However, I got clearly better results with both off, enough to convince me to stop the tests immediately after 3 rounds.The problem was that while context use did go down (sometimes), the number of turns to complete went up so the overall cost of the conversation was higher.It's made me very aware of one thing: so many people are sharing these kind of tools, but either with zero evals (or suspiciously hard to reproduce), or in the case of this one, extensive benchmarks testing the wrong thing.I'm sure this tool does use fewer tokens than grep, and the benchmarks prove it, but that's not what matters here. What matters is, does an agent using it get the same quality of work done more quickly and for lower cost?
AussieWog93 • May 17, 2026
Better than grep obviously, but how does this compare to existing LSPs?
nextaccountic • May 17, 2026
How does this compare with colgrep?https://github.com/lightonai/next-plaid/tree/main/colgrep
singpolyma3 • May 17, 2026
Semantic code search seems like a useful tool for a human too. Not just for agents.
jerezzprime • May 17, 2026
I'd be interested in seeing actual agent benchmarks (eg CC or Copilot CLI with grep removed and this tool instead).For example, I have explored RTK and various LSP implementations and find that the models are so heavily RL'd with grep that they do not trust results in other forms and will continually retry or reread, and all token savings are lost because the model does not trust the results of the other tools.

Frequently Asked Questions

Market intelligence mapped to Semble, an open-source code search tool for AI agents. It combines static Model2Vec embeddings (potion-code-16M) with BM25, fused via RRF, and reranked with code-aware signals. It runs on CPU without transformers..

What problem does Semble, an open-source code search tool for AI agents. It combines static Model2Vec embeddings (potion-code-16M) with BM25, fused via RRF, and reranked with code-aware signals. It runs on CPU without transformers. solve?
Based on our AI analysis of the original developer request, its primary technical positioning is: A token-efficient, fast, and accurate alternative to grep+read for AI agents (Claude Code, Cursor, Codex, OpenCode) when searching large codebases. It claims 98% fewer tokens than grep+read and 99% retrieval quality of a 137M-parameter transformer, while being ~200x faster. It is zero-config, requiring no API keys, GPU, or external services.
Are engineers actively discussing Semble, an open-source code search tool for AI agents. It combines static Model2Vec embeddings (potion-code-16M) with BM25, fused via RRF, and reranked with code-aware signals. It runs on CPU without transformers.?
Yes, we have tracked 50 direct responses and active debates regarding this specific topic originating from Hacker News.
What are the foundational technologies related to Semble, an open-source code search tool for AI agents. It combines static Model2Vec embeddings (potion-code-16M) with BM25, fused via RRF, and reranked with code-aware signals. It runs on CPU without transformers.?
Our proprietary extraction maps Semble, an open-source code search tool for AI agents. It combines static Model2Vec embeddings (potion-code-16M) with BM25, fused via RRF, and reranked with code-aware signals. It runs on CPU without transformers. to adjacent architectural concepts including Model2Vec embeddings, potion-code-16M, BM25, RRF.

Engagement Signals

202
Upvotes
50
Comments

Cross-Market Term Frequency

Quantifies the cross-market adoption of foundational terms like Claude Code and Codex by tracking occurrence frequency across active SaaS architectures and enterprise developer debates.