Detailed Analysis
A Reddit user's question in r/ClaudeAI cuts to a technical nuance that has largely been glossed over in mainstream discussion of AI text watermarking: whether statistical watermarking schemes actually function when AI is used only to lightly edit human-written text, as opposed to generating content from scratch. The poster's intuition is fundamentally correct and reflects a real limitation of how these systems work. Token-level watermarking, the approach most commonly discussed in connection with large language models including Claude, operates by subtly biasing the probability distribution over next-token choices during generation, favoring a pseudo-randomly selected subset of tokens ("green list" tokens in the terminology popularized by the Kirchenbauer et al. watermarking paper) at each generation step. Detection then relies on statistically identifying an anomalous concentration of these favored tokens across a sufficiently long stretch of text. The watermark's strength is therefore proportional to the number of tokens where the model actually had meaningful freedom to choose among plausible alternatives.
This is precisely why light copyediting breaks the premise of watermark detection. When a model is correcting a typo, fixing subject-verb agreement, or making a minor grammatical repair, there is often exactly one correct token to insert, or a very small set of near-equivalent options. The model has essentially no entropy to work with at those positions, meaning no meaningful choice between a "green" and "red" token, so no statistically detectable bias can be embedded there. A watermarking algorithm applied to such text would produce a signal too weak and too sparse to distinguish from human writing, since the entropy of the token distribution—not just whether AI touched the text—is the determining factor in whether a watermark can be reliably planted and later recovered. This means the common critique that watermarking unfairly "flags" or fails on both AI-generated prose and AI-assisted human prose in the same way is not quite accurate: the two cases are technically distinguishable in principle, because heavier AI involvement (more original phrasing decisions) generates a stronger, more detectable statistical fingerprint, while minimal edits generate a weak or negligible one.
Where the user's framing runs into real-world complexity is that "revision and editing" exists on a spectrum, and detection systems cannot cleanly separate degrees of AI contribution within a single document. A text that starts as human-written but gets substantially rephrased, restructured, or stylistically "improved" by AI—common uses of tools like Claude for polishing prose—can introduce enough token-level choice to leave a detectable partial watermark in the rewritten passages, even though the underlying ideas and structure remain human. Detection tools typically report a probability or confidence score rather than a binary verdict, and with only a portion of a document actually watermarked (the AI-touched spans), that confidence score can be diluted below reliable detection thresholds even for texts that did involve substantive AI rewriting. This creates a messy middle ground: minimal edits are essentially invisible to watermarking, heavy AI rewriting is often detectable, and everything in between yields uncertain, probabilistic results that are easy for critics to characterize as unreliable or unfair regardless of the underlying technical accuracy.
This distinction matters because it underlies much of the current uncertainty around AI content policies in academia, journalism, and publishing, where institutions are trying to draw bright lines around "AI use" that the underlying detection technology cannot actually support with precision. Anthropic and other labs marketing watermarking as a transparency or provenance tool are implicitly making claims about generation-time control that do not extend cleanly to mixed human-AI editing workflows, which are now the dominant real-world use case for tools like Claude among writers, students, and professionals. As watermarking, statistical detectors, and metadata-based provenance standards (such as C2PA) continue to be proposed as solutions to AI content authenticity, the entropy problem the Reddit poster identified—that watermarks require meaningful token-level choice to exist at all—will remain a persistent limitation. It suggests that policy debates conflating "AI-assisted" with "AI-generated" are working from a technically imprecise premise, and that any robust framework for governing AI-touched content will need to account for gradients of AI involvement rather than treating detection as a simple yes-or-no proposition.
Read original article →