Robots.txt
What are you putting in your robots.txt ?
Mine is:
But I wonder if it's a good idea.
Is it better to let Google crawl these ?
I can see in my Google Search console there are 370 not indexed pages (for 11 indexed) which are all api/_content/query/ urls.
Should I remove the Disallow ?
0 Replies