"AI will never offer you that kind of honesty." Unless you ask it to.
Which you do note in your next line: "I always ask the AI to cross-reference my AI-generated epiphanies against peer-reviewed research. The results are sobering. Every "groundbreaking" idea turned out to be either decades-old common knowledge or just incorrect."
I'm not downplaying the point you're making. I think the risk for many is great. And I also recognize that I am not immune. I agree that "We need to demand that the companies building these models take this risk seriously and re-orient them toward truth."
I just think that in the meantime, we can stay vigilant in commanding it to push back on us at all turns.
"AI will never offer you that kind of honesty." Unless you ask it to.
Which you do note in your next line: "I always ask the AI to cross-reference my AI-generated epiphanies against peer-reviewed research. The results are sobering. Every "groundbreaking" idea turned out to be either decades-old common knowledge or just incorrect."
I'm not downplaying the point you're making. I think the risk for many is great. And I also recognize that I am not immune. I agree that "We need to demand that the companies building these models take this risk seriously and re-orient them toward truth."
I just think that in the meantime, we can stay vigilant in commanding it to push back on us at all turns.