Technically that doesn’t prove Socrates never said it, he might’ve, though it would be one hell of a coincidence. It amuses me to think we’ll never know.

It depends on the type of facts, but sometimes it’s much easier to verify an answer than to get the answer in the first place. For example sometimes the LLM will mention a keyword that you didn’t know or didn’t remember and that makes googling much easier.