GitHub - icvoss/django-icv-sitemaps: Scalable sitemap generation and web discovery infrastructure for Django — background XML sitemaps (standard/image/video/news), robots.txt, llms.txt, ads.txt, security.txt, humans.txt. · GitHub
[en](github.com)
Pas mal de contenu géré de manière automatique relatif au crawling (sitemaps, llm.txt, ads.txt, robots...).