5-10 years ago, you could be pretty sure this was a thing that actually needed checked, since the post about the clutch safety switch was posted by a real person who presumably had the same problem as you and fixed it with this method.
Now, there’s no way to know if that’s actually the case, or if “clutch safety switch” is just a likely string of words to feed someone who is having car trouble. You might get lucky, or you might get sent on eight consecutive goose chases because an LLM fundamentally doesn’t know what factual knowledge is, it only knows how to reorder and regurgitate things that other people have said in other contexts.
The problem is that right now would be the peak of this information being available. What are you going to find in 20 years when everyone has abandoned forums in favor of asking ChatGPT for all the answers? There would be nothing left to train the models on.
5-10 years ago, you could be pretty sure this was a thing that actually needed checked, since the post about the clutch safety switch was posted by a real person who presumably had the same problem as you and fixed it with this method.
Now, there’s no way to know if that’s actually the case, or if “clutch safety switch” is just a likely string of words to feed someone who is having car trouble. You might get lucky, or you might get sent on eight consecutive goose chases because an LLM fundamentally doesn’t know what factual knowledge is, it only knows how to reorder and regurgitate things that other people have said in other contexts.
I agree with the larger point you’re making, but chatbots are getting better at referencing posts / websites from which they’re taking a solution.
That’s if and only if of course they used a web search tool to answer, and if that website is still alive — made less likely due to AI.
But for debugging something like this, it is actually helpful for now with citations enabled.
The problem is that right now would be the peak of this information being available. What are you going to find in 20 years when everyone has abandoned forums in favor of asking ChatGPT for all the answers? There would be nothing left to train the models on.
I’m here now so me want thing now!