romain
romain
PostsComments
NNuxt
Created by romain on 8/6/2024 in #❓・help
Robots.txt
What are you putting in your robots.txt ? Mine is: 
robots: {
  disallow: [
    '/api/_content',
    '/_nuxt'
  ],
  credits: false
}
robots: {
  disallow: [
    '/api/_content',
    '/_nuxt'
  ],
  credits: false
}
But I wonder if it's a good idea. Is it better to let Google crawl these ? I can see in my Google Search console there are 370 not indexed pages (for 11 indexed) which are all api/_content/query/ urls. Should I remove the Disallow ?
1 replies