Search
Items tagged with: robotsTxt
#fediAdmin #fediTips #fediVerse
To begin with I wonder what happens if our sites and profiles display CC-BY-SA-NC as #copyright notice. Any use by #AI scrapers should become illegal and indemnisation inforcable.
Also if you search for #robotsTXT in google, this is what you get.
> Ignoring robots.txt instructions can result in your scraping activities being considered unethical or even illegal.
#meanWhile ..
.. the #mastodon community wastes it's time trying to pimp up the stars of it's #APP in #googlePlay, the #robotsTxt of it's instances disallows exactly one #AI bot scrapper to not search for all public data available about the #fediVerse. Not only on it's mother ship but on all instances, so the elonGated can create his target lists of "the enemy inside".
.. good job, well done! ..
> User-agent: GPTBot
> Disallow: /