Robots.txt generator

Pick what to block, add your sitemap, copy the file. The AI crawler switches are the part most generators still do not have — and the part most sites now need to think about.

Paths to block (one per line)Sitemap URL

Block these AI crawlers

Blocking these keeps your pages out of AI answers. Most sites want the opposite — being cited by ChatGPT and Perplexity now sends real traffic.

Output

User-agent: *
Allow: /
Disallow: /admin/
Disallow: /cart/
Disallow: /checkout/
Disallow: /search

Free SEO tools

Free SEO checkerAudit any page: title, meta, canonical, hreflang, schema, alt text.Social preview checkerSee how a link looks on X, LinkedIn, WhatsApp and Slack.Hreflang checkerWe fetch each alternate and check whether it points back.Robots.txt testerTest a path against robots.txt for ten different crawlers.Redirect and header checkerFollow the full redirect chain with status codes and headers.Sitemap validatorValidate an XML sitemap: counts, lastmod, hreflang, x-default.SERP snippet previewSee where Google cuts your title and description — in pixels.Content analyserWord count, reading time, readability and phrase frequency.Schema markup generatorBuild valid JSON-LD for Article, FAQ, Product, Organization and more.Meta tag generatorComplete head block: title, description, canonical, OG, Twitter.Hreflang tag generatorReciprocal hreflang tags with x-default, as HTML or sitemap XML.URL slug generatorClean slugs from any language — accents transliterated, not dropped.

Your competitors published today.

Bora is an automated SEO tool that researches keywords, writes articles with schema, FAQ and internal links, and publishes them to your site every day — in any of 40 languages, to WordPress, Webflow, Shopify, Wix, Ghost, Notion or Next.js, from $39 a month per website.

Pricing