← Reddit

I built a local web research MCP for Claude Code that filters webpages before they eat your context window

Reddit · Scared-Tip7914 · July 28, 2026
An open-source MCP server called TinySearch reduces token inefficiency in Claude Code's web research by filtering and ranking webpage content locally before it enters the model's context window. The tool performs hybrid retrieval, extracts readable content, removes boilerplate, and sends compact evidence packets instead of raw webpage text. TinySearch is free and self-hosted, requiring no paid search API.

Detailed Analysis

A developer has released TinySearch, an open-source, self-hosted MCP (Model Context Protocol) server built specifically to address a token-efficiency problem observed in Claude Code's native web research workflow. The core issue: when Claude Code searches the web, opens multiple pages, and pulls raw HTML or webpage text into its context window, a substantial share of tokens gets consumed not on reasoning but on processing boilerplate, navigation elements, ads, and redundant content before Claude can even identify which passages are actually relevant. TinySearch intervenes before that content ever reaches the model — performing search, ranking, crawling, content extraction, deduplication, and local reranking outside of Claude's context, then delivering a compact "evidence packet" with source URLs. The tool exposes three MCP functions (research, scrape_url, and get_current_datetime) and runs with local embeddings and reranking by default, requiring no paid search API or hosted account, which lowers the barrier for developers to adopt it via a simple uvx-based configuration.

This release reflects a broader maturation of the Claude Code ecosystem, where third-party developers are building infrastructure to compensate for gaps in Anthropic's native tooling rather than waiting for the company to solve every workflow inefficiency itself. MCP, the open protocol Anthropic introduced to let Claude and other models connect to external tools and data sources, has become fertile ground for exactly this kind of community-driven extension. TinySearch is a pointed example of "context engineering" — a discipline that has grown alongside agentic coding tools as developers realize that model capability alone isn't the bottleneck; how information is curated, filtered, and presented to the model before it reasons over that information is often equally decisive. As context windows get larger, the temptation is to assume the problem disappears, but larger windows still cost money per token, still risk diluting the model's attention with noise, and still slow down inference — meaning tools that pre-filter and compress information before ingestion remain valuable regardless of window size.

The project's design choices — self-hosted, no required API key, local ranking — also speak to a growing preference among power users for tools that avoid vendor lock-in and recurring costs, particularly for infrastructure-adjacent utilities like search retrieval. By explicitly scoping TinySearch as a lightweight retrieval layer rather than a replacement for commercial search providers with SLAs or large-scale indexing guarantees, the author is positioning it within a niche but increasingly common category: purpose-built, narrow tools optimized for agentic coding assistants rather than general-purpose search products. This mirrors a pattern seen elsewhere in the Claude Code and broader agent-tooling space, where specialized MCP servers for tasks like file search, database querying, and browser automation are proliferating as developers discover that generic tool integrations often waste context or attention that could otherwise go toward the actual coding or reasoning task.

Finally, the developer's open call for benchmark ideas against Claude Code's native WebSearch and WebFetch tools signals an important trend: as agentic tooling diversifies, the community is beginning to demand more rigorous, standardized ways to measure token efficiency and retrieval quality, not just anecdotal token savings. This kind of grassroots benchmarking pressure could eventually influence how Anthropic and other foundation model providers design their own native tools, especially if independent projects like TinySearch demonstrate measurable reductions in context consumption without sacrificing answer quality. It's a small but telling data point in the larger story of AI agents becoming more efficient not merely through bigger or smarter models, but through better-engineered surrounding infrastructure.

Read original article →