>If you wrote a flashing big red warning, something like the following, couldn't everybody be satisfied? "CAUTION. This technology is still very early and may produce completely incorrect or even dangerous results. Any output by this tool should be considered false and is only suitable for entertainment purposes until expert human judgement verifies the results."
I'll give you the benefit of the doubt since the demo is now offline but there was in fact a giant disclaimer that said more or less: "DO NOT TRUST THE OUTPUT OF A LANGUAGE MODEL WITHOUT VERIFICATION."
It did...but it also said stuff like "ACCESS ALL OF HUMANITY'S KNOWLEDGE!!!"
They were trying to have it both ways, where the headline giveth and the fine print taketh away.
In a better world, this could have been released as "We trained a language model on the scientific literature. We're excited because it is starting to draw conclusions, but there is obviously a lot more to be done. See our evaluation here. Have fun and let us know what you find."
The hype is really annoying and seems bizarre--everyone who even remotely cares knows about Meta already.
That was only present on the bottom half of the "Mission" page - the main page and other pages were full of examples of all the marvelous things it can do (that it can't really do reliably) [0].
I'll give you the benefit of the doubt since the demo is now offline but there was in fact a giant disclaimer that said more or less: "DO NOT TRUST THE OUTPUT OF A LANGUAGE MODEL WITHOUT VERIFICATION."