If we ever build an AI that can think and feel, does Optimus’s logic apply to it automatically? Or is Megatron secretly onto something, that freedom has to be earned rather than assumed? And if an LLM ever crossed that line into real sentience, would we even be able to tell?
Fair enough, I appreciate the clarification.
I would posit philosophically that the LLM cannot build off of the knowledge of others in the way that a human (like the mathematician) could, and so it is not capable of forming an original thought.
When an LLM model is trained, it is left in a sort of static state of “knowledge”. The model does not have “compounding memory” the way humans do; When a human finishes their education (training) and begins their career they usually continue to learn and gain experience throughout the course of their career.
An LLM doesn’t remember anything, not its experiences, not events that you tell it about, not the last time you prompted it. If you want to teach the LLM something new, you have to re-train the thing. It can’t learn on its own