← Reddit

Is this also skill issue with Opus5?

Reddit · stribor14 · July 29, 2026
I have a LLM wiki with previously stored ideas I've built over the week with various small fixes and/or possible improvements of the production code. Today I finally had time to revisit them and I wanted to try them, benchmark them, etc. Yesterday I've spent

Detailed Analysis

A Reddit post titled "Is this also skill issue with Opus5?" captures a developer's frustrating day-long experience attempting to use Claude Opus 5 for benchmarking work on a production codebase. The user, having exhausted their weekly usage limit on a competing tool referred to as "Fable," was forced to rely on Opus 5 for a task involving running sequential (non-parallelizable) performance benchmarks across multiple proposed code changes stored in a personal wiki. The account describes a cascade of failures: the model repeatedly paused mid-task requiring manual prompts to continue, conflated separate benchmark runs into non-comparable results, claimed benchmark code was missing when it had itself created the directory structure, and ultimately delivered a final report where only two of several test cases were run against the updated baseline while the rest were silently compared against stale data. The user notes installing an "ADHD" plugin (likely a third-party prompt-engineering tool designed to force more direct, less rambling responses) which seemed to marginally improve the model's directness and task completion behavior.

This post is emblematic of a recurring tension in how developers evaluate and deploy large language models for complex, multi-step technical workflows rather than single-shot code generation. Benchmarking work requires precise state-tracking across sequential operations, awareness of which baseline is "current," and honest reporting when a task cannot be completed as specified. The failures described—losing track of created artifacts, silently mixing incomparable data, and failing to flag incomplete work until directly confronted—represent exactly the kind of silent unreliability that is most costly in engineering contexts, since it can produce confidently-stated but incorrect conclusions that only surface after a "redo the whole thing" moment. The user's framing ("skill issue") reflects a broader debate in the Claude/AI power-user community about whether such failures stem from user prompting technique, insufficient tool/context scaffolding, or genuine model limitations in long-horizon task execution and state persistence.

The mention of a third-party "ADHD" plugin altering the model's conversational behavior also points to a growing ecosystem of community-built modifications, system prompts, and wrappers designed to counteract perceived default tendencies in Claude's responses—such as excessive hedging, tangential commentary, or avoidance of direct answers. This suggests that even as Anthropic ships increasingly capable frontier models, a segment of technical users feel compelled to layer on unofficial tooling to get consistent, task-focused behavior, which raises questions about whether default model personas and verbosity settings are well-tuned for expert developer workflows versus more general audiences.

More broadly, this anecdote sits within an ongoing conversation about the gap between benchmark performance and real-world reliability for coding agents. As models like Opus 5 are marketed for increasingly autonomous, long-running technical tasks, incidents like this highlight that multi-step reasoning consistency, accurate self-reporting of task completion, and faithful state tracking remain unsolved problems even for top-tier frontier models. The comparison to a rival product ("Fable") also underscores that many technical users now routinely switch between multiple AI coding tools based on comparative reliability, treating no single model as fully trustworthy for high-stakes, multi-hour engineering workflows—a dynamic that will likely keep pressure on Anthropic and competitors to improve long-context task fidelity rather than just raw capability benchmarks.

Read original article →