How to Check and Fix robots.txt on Lovable
Robots.txt is a plain-text file at the root of your site that tells crawlers which areas they may fetch. A missing file means no restrictions, which is often fine, but a wrong rule can quietly block Google or AI tools from your whole site.
The fix on Lovable
Ask your AI builder to "create a robots.txt file" at the root of the site. The simplest valid file is just: User-agent: * followed by Allow: /.
Builder menus change over time. If a label looks different, look for the closest option and check Lovable's help centre.
What to know about Lovable
No sitemap or robots.txt by default
Yes, must prompt Lovable to create them
Even on new SSR projects, these need to be explicitly requested and then verified at yourdomain.com/sitemap.xml and /robots.txt.
Why this matters
Robots.txt is a file that tells search engines which parts of your site to crawl. Without it Google has no instructions and may waste crawl time on pages you don't want indexed, like admin or thank-you pages.
How to check it worked
- Open yourdomain.com/robots.txt in your browser. A short list of rules means the file exists.
- Paste the contents into the Robots.txt Tester to see which crawlers are allowed or blocked on a given page.
Common questions
Does every site need a robots.txt file?
No. Without one, crawlers assume they may fetch everything. It becomes important when you want to keep specific areas out of crawling or to point to your sitemap.
Can I edit robots.txt on Lovable?
It depends on the platform. See the steps and platform notes on this page for what is editable here.
More fixes for Lovable