Robots.txt Generator

关于产品

Build a clean robots.txt without memorizing the syntax. Pick a bot (All, Google, Bing, Yahoo, DuckDuckGo or Baidu), add Allow or Disallow rules, and set your sitemap, crawl-delay and host. Or start from a preset: Allow All, Disallow All, WordPress, E-commerce, or Block Bad Bots, which blocks known scrapers and AI crawlers. A live preview shows the file as you build it. You can validate it, import an existing robots.txt to edit, and copy or download. No signup.

关键词