Fascinating report from 404 Media's Samantha Cole on a trove of leaked NVIDIA Slack messages and emails about how they're scraping millions of YouTube videos to train their own new foundation video generation model: https://www.404media.co/nvidia-ai-scraping-foundational-model-cosmos-project/
Posted a few of my own notes here: https://simonwillison.net/2024/Aug/5/nvidia-scraping-videos/
It's not surprising to learn that they're doing this - that's practically the industry standard right now - but is still really interesting to see internal details of what they're collecting and why
every now and then i feel like im taking crazy pills because i remember when aaron swartz killed himself because he was going to go to jail forever because he scraped JSTOR,
and twenty years later your manager tells you “sshhhh it’s fine just scrape all of it don’t worry the CEO said it’s fine”
@zachdecook @phillmv @simon He was going to jail for not showing enough deference to his overlords.