Custom files — robots.txt, sitemap.xml, llms.txt

Your website generates robots.txt, sitemap.xml and llms.txt automatically, and keeps them up to date. Custom files let you replace any of them with your own version.

Open Custom files#

Go to https://yourdomain/admin/custom-files (it is not in the admin menu).

Add a custom file#

1. Select Add New — Create Custom File.
2. Name — choose the file: robots.txt, sitemap.xml, llms.txt or .htaccess.
3. Type — Text (type or paste the content) or File Upload (upload a file).
4. Save. The file is served at yourdomain/<name> straight away.

To go back to the generated version, delete the custom file.

The mistake that hides your site from Google#

A custom robots.txt containing

User-agent: *
Disallow: /

tells every search engine to ignore your entire website. It is sometimes added while a site is being built and then forgotten. If your site is not appearing on Google, check this first — see Not showing on Google.

.htaccess#

An .htaccess file adds server rules, such as redirects. For security, only a safe set of rules is accepted; anything else is refused. Use it only if you know what you are doing — a wrong rule can make your site unreachable. When in doubt, ask support.