https://www.nytimes.com/2020/12/14/technology/how-google-dominates.html?referringSource=articleShare

Democratize the web crawler. To me this should be regulated requiring website owners to allow access to more than just Microsoft and Google say, access to all crawlers or at least 1-2 independent ones. Since crawling frequency can be set in the robtot.txt settings that should not be too much of a drain for say Instagram or Facebook.