AI slop isn’t obvious. That’s what makes it dangerous.

If an AI gave you complete nonsense, you’d catch it. The problem is when it gives you something fluent, confident, and “mostly” correct — with a flaw buried in the middle that you’ll only find if you already know the answer.

That’s the thing about AI as a research tool: it will give you the consensus view, coherently expressed, at the level of resolution that the training data supports. Where the training data is thin, ambiguous, or where real expertise requires distinguishing between things that *look* similar but aren’t — that’s where it fails. And it fails confidently.

Even when you use the deep research tools there are problems. When I was developing some content for my YouTube channel, The Unretired Engineer I ran into this doing research on Wolfspeed’s financial situation and the SiC power electronics market. I asked a deep research tool to pull together an analysis. What came back looked thorough. The problem was that it took a lot of information that had gone out about the future of the fab and future plans for markets and conflated them with what had happened and what was likely to happen in the near future.

To someone without a background with Wolfspeed and the real status of the SiC, the analysis would have read as authoritative. It wasn’t. It had serious timing errors delivered with confidence. I knew it was wrong because I’d spent years in that space. If I hadn’t, I might have taken it as written.

The fix isn’t to stop using it. The fix is to put yourself into it.

When I work with AI on my engineering writing, or on the physics underlying my novels, I’m not asking it to do the thinking. I’m using my domain knowledge to steer it, to catch the near-misses, and to push it past the consensus into territory where the expertise actually matters. The AI amplifies what I bring. Without that, it’s just averaging.

Use it as a tool. But know what it can’t know — and that’s usually the thing that matters most.

—

https://youtube.com/shorts/mbmKm_JcHQ0?feature=share

Mark Harris is a system and mechanical engineer and the author of “Stranded in the Stars” (Book One, The Sea of Suns Trilogy), available now on [Amazon](https://www.amazon.com/Stranded-Stars-M-Harris-ebook/dp/B0GT123PLP)