#Web Crawler#

Meta Releases New Web Crawler for AI Training Data

Meta quietly released a new web crawler. It's similar to OpenAI's GPTBot and collects data for AI models. Its existence shows Meta's database may not be enough.