Robots.txt generator

Choose what crawlers may access, add your sitemap, and decide whether AI training crawlers are allowed. Copy or download the finished file.

One per line. Use * as a wildcard and $ for "ends with".

Exceptions inside blocked folders.

One per line. Must be full URLs.

AI crawlers

Tick to block a crawler. Blocking training crawlers does not remove you from normal search.

WhatsApp Book call Fiverr

Office location

BlogMaster360 Agency

M-9 New City Bahawalnagar NEW CITY M BLOCK HOUSE NO 9

Open in Google Maps Get directions