← Reddit

I built a Claude/Codex skill that researches comparable repos before giving project advice

Reddit · Scared_Objective_345 · May 30, 2026
A developer created advise-project-approach, a Claude/Codex skill designed to address the problem of AI tools recommending technology stacks with unwarranted confidence despite not examining what similar projects actually used. The skill researches comparable real-world repositories before offering stack direction, architecture notes, alternatives, and build improvement plans across three project phases: before building, during development, and before shipping. The creator seeks feedback on whether the skill's workflow is appropriately scoped and genuinely useful.

Detailed Analysis

A developer identified as AaravKashyap12 has released an open-source tool called `advise-project-approach`, a skill built on top of Claude and OpenAI's Codex that addresses a specific and widely observed limitation in AI-assisted software development: the tendency of AI tools to recommend technology stacks and architectural patterns without grounding those recommendations in evidence from comparable, real-world projects. The tool is hosted on GitHub and is designed to integrate into three distinct phases of a software project — pre-build stack selection, mid-build architectural reassessment, and post-build review prior to shipping. Its core mechanism involves searching for and analyzing comparable repositories before generating any advisory output, thereby anchoring its recommendations in observed practice rather than generic best-guess heuristics.

The significance of this tool lies in its attempt to solve a credibility problem that has become a recurring friction point in developer communities. AI coding assistants, including Claude, are frequently criticized for delivering stack recommendations with unwarranted confidence — presenting opinionated choices as if they were universally applicable, without acknowledging the constraints of the user's specific domain, scale, or team composition. By incorporating a comparable-repo research step, the skill introduces an empirical checkpoint into the advisory loop, making the rationale behind recommendations more transparent and falsifiable. The explicit inclusion of failure modes — where the recommendation might break — is a notable design choice that signals an attempt to counteract the overconfidence that characterizes many AI outputs.

The project also reflects a growing ecosystem of "skills" and agent-layer tooling built on top of foundation models like Claude. Rather than waiting for Anthropic or OpenAI to natively improve grounding and citation behavior, independent developers are constructing middleware that enforces research-first workflows at the prompt and orchestration level. This pattern — wrapping raw model capability in structured, task-specific logic — is becoming a common architectural approach as practitioners discover the gap between what large language models can do in principle and what they reliably do in practice without structured scaffolding.

The developer's explicit request for feedback on the `SKILL.md` file itself reveals another dimension of this trend: the formalization of AI interaction patterns as shareable, critiquable artifacts. SKILL.md files function somewhat like prompt engineering specifications or agent behavior contracts, and the fact that the author is soliciting community review of the workflow design rather than just the code signals a maturing discourse around how to define and evaluate AI agent behavior. This is consistent with emerging norms in the Claude developer community, where system prompt architecture and task decomposition strategies are increasingly treated as first-class engineering concerns.

Broader trends in agentic AI development are clearly visible in this project. The tool's three-phase structure — before, during, and after building — mirrors the lifecycle thinking that serious software teams apply to tooling decisions, and applying that same framework to AI advisory systems suggests that developers are beginning to think more rigorously about where and how AI fits into professional workflows. If the community validates the approach, projects like this could influence how Anthropic and others think about grounding, citation, and confidence calibration natively within Claude's capabilities — making developer-built skills a form of living feedback on where foundational model behavior still falls short.

Read original article →