Character AI has filed a motion to dismiss a case brought against it by the parent of a teen who committed suicide allegedly after becoming hooked on the company's technology.
Making stuff up is the entire function of an LLM, they are predictive text generators that string words together based on how the algorithm predicts a human would given the same input to produce a plausible answer.
Not the correct answer necessarily, only one that feels like it could have been written by a human.
Censoring or controlling them in a way people would want to or expect companies to do is basically impossible because it would require them to actually be able to understand what they are talking about in the first place.
Making stuff up is the entire function of an LLM, they are predictive text generators that string words together based on how the algorithm predicts a human would given the same input to produce a plausible answer. Not the correct answer necessarily, only one that feels like it could have been written by a human.
Censoring or controlling them in a way people would want to or expect companies to do is basically impossible because it would require them to actually be able to understand what they are talking about in the first place.