They are prone to making stuff up, but less prone to sticking to it on interrogation (although obviously that does happen, and Gemini used to be terrible for this). I find restating my new understanding of something to a new context window to be a valuable part of the learning process, and most likely saves me here, esp as I have memories switched off.

I use LLMs a lot for medical advice and will normally take a bunch of second opinions from clean windows and other LLMs. Hasn’t killed me yet!