¯\_(ツ)_/¯ would I get downvoted for saying skill issue lol?
I have recently used llms for troubleshooting/assistance with exposing some self hosted services publicly through a VPS I recently got. I'm not a novice but I'm no pro either when it comes to the Linux terminal.
Anyway long story short in that instance the tool (llm) was extremely helpful in not only helping me correctly implement what I wanted but also explaning/teaching me as I went. I find llms are very accurate and helpful for the types of things I use it for.
But to answer your question on why llms can be wrong, it's because they are guessing machines that just pick the next best word. They aren't smart at all, they aren't "ai" they are large language models.
Go on the ADHD meme subs here and absolutely everything they post is normal human behaviour imo