New episode is out! @dsearls and @katherined talk to @eze_lanza and Tony Mongkolsmai about #ChatGPT, generative #AI, and #opensource software.
Episode 135 - Experts Weigh in on ChatGPT. Listen here: https://www.reality2cast.com/135
#podcast #newEpisode #tech
Hi, thanks for an interesting discussion.
Here is one question I think you missed: for that kind of AI system that is "trained" on data from the internet, suppose now that in the future the "new" content added to web pages will be increasingly generated by such systems. Then when the systems are to be improved by training on the new added content, they are increasingly taking in their own earlier output as new training input.
1/?
Will the systems still improve in that situation, or will things stagnate because of lack of real input from real human beings?
I guess that if you think there is no problem with that, then you could already construct such a feedback loop where the system eats its own output as input. Does that work, or not?
Will "original content" created by actual humans capable of original thought become increasingly rare and increasingly valuable?
2/2
@eliasr @reality2cast @dsearls @katherined @eze_lanza Interesting thought Elias that I haven't thought of. Another question I have, how does AI fact check? Eager to hear what the podcasters have to enlighten us!
@hehemrin @eliasr @reality2cast @dsearls @eze_lanza That's the thing. In the case of ChatGPT, fact checking is crowd-sourced, but I don't think it could fact check itself without human input, but I'd defer to @eze_lanza on that. It definitely has accuracy issues today in its current state. Significant ones, as we mentioned in the podcast. Depending on the prompt, it might make up something totally nonsensical that could seem true.
@katherined @hehemrin @eliasr @reality2cast @dsearls I can be pretty sure they do have some validation checks (policies or rules) but it's almost impossible to have rules for every topic, so they need people feedback which is gold!