A robots.txt file acts like a map for search engine crawlers, guiding them to important pages while blocking out duplicates or sensitive areas. This improves your SEO ranking by focusing crawl budget on valuable content and protecting customer data, giving your online store a leg up in the competition.
Editing
To edit your Styla robots.txt:
1. Log into your Styla account and hover over the cog-Wheel and select robots.txt
2. On the resulting screen, add or edit the content of your robots.txt
3. Click the "Apply Changes" button. A success message will appear.
4. Check yourdomain.com/robots.txt for the result.
(It can take a couple of minutes for updates to show up as they propagate through the CDN)
Content
A basic robots.txt might have the following content:
Sitemap: https://yourdomain.com/sitemaps.xml
User-agent: *
Disallow: /checkout
Disallow: /cart
Disallow: /notfound
Disallow: /login
Disallow: /logout
Disallow: /order
Disallow: /signup
Disallow: /account*
Disallow: /search?q=*
Disallow: /home
Disallow: /all-modules
Comments
0 comments
Please sign in to leave a comment.