Is less memory actually better?

I often see people putting out ideas or apps for expanding memory, especially across projects. Claude code seems to be using its native memory more aggressively too. But I find myself over time wanting less and less 'memory" and documentation. I built myself