{"id":13470,"date":"2017-12-26T09:16:19","date_gmt":"2017-12-26T08:16:19","guid":{"rendered":"http:\/\/www.jng-web.com\/labo\/?p=13470"},"modified":"2023-03-22T21:38:20","modified_gmt":"2023-03-22T20:38:20","slug":"fichier-robots-txt-cest-quoi","status":"publish","type":"post","link":"https:\/\/jng-web.com\/labo\/fichier-robots-txt-cest-quoi\/","title":{"rendered":"Le fichier robots.txt, c\u2019est quoi ?"},"content":{"rendered":"<div class=\"advads-avant-le-contenu\" id=\"advads-332941307\"><script async src=\"\/\/pagead2.googlesyndication.com\/pagead\/js\/adsbygoogle.js?client=ca-pub-4944504088214075\" crossorigin=\"anonymous\"><\/script><ins class=\"adsbygoogle\" style=\"display:block;\" data-ad-client=\"ca-pub-4944504088214075\" \ndata-ad-slot=\"4514395581\" \ndata-ad-format=\"auto\"><\/ins>\n<script> \n(adsbygoogle = window.adsbygoogle || []).push({}); \n<\/script>\n<\/div><div class=\"advads-test\" style=\"margin-left: auto;margin-right: auto;text-align: center;\" id=\"advads-1294465736\"><script async src=\"\/\/pagead2.googlesyndication.com\/pagead\/js\/adsbygoogle.js?client=ca-pub-4944504088214075\" crossorigin=\"anonymous\"><\/script><ins class=\"adsbygoogle\" style=\"display:block;\" data-ad-client=\"ca-pub-4944504088214075\" \ndata-ad-slot=\"4514395581\" \ndata-ad-format=\"auto\"><\/ins>\n<script> \n(adsbygoogle = window.adsbygoogle || []).push({}); \n<\/script>\n<\/div><p>Vous avez tr\u00e8s certainement \u00e0 un moment ou un autre entendu parler de loin ou de pr\u00e8s du fichier robots.txt.<\/p>\n<h2>A quoi sert ce fichier robots.txt\u00a0?<\/h2>\n<p>Ce fichier permet d\u2019indiquer aux moteurs de recherche les fichiers et parties d\u2019un site \u00e0 ne pas indexer. Cependant, vous noterez que ce fichier ne permet pas de prot\u00e9ger un fichier par un mot de passe.<\/p>\n<h2>Quelle est la taille maximale de ce fichier\u00a0?<\/h2>\n<p>En ce qui concerne le robots.txt, le fichier est limit\u00e9 \u00e0 une taille de 500 Ko. Si vous le souhaitez, vous pouvez d\u00e9passer cette limite. Cependant, vous devez garder \u00e0 l\u2019esprit que tout ce qui d\u00e9passe cette limite sera tout bonnement ignor\u00e9 par Google.<\/p>\n<h2>Devez-vous cr\u00e9er un fichier robots.txt\u00a0pour chaque sous-domaine ?<\/h2>\n<p>Pour chacun des sous-domaines, vous devrez cr\u00e9er un fichier robots.txt<\/p>\n<h2>Votre robots.txt peut-il \u00eatre vide\u00a0?<\/h2>\n<p>M\u00eame si cela peut vous surprendre, un fichier robots.txt peut \u00eatre vide.<\/p>\n<h2>Quels contenus devez-vous bloquer\u00a0?<\/h2>\n<p>Les contenus \u00e0 bloquer sont ceux qui ont peu ou pas d\u2019int\u00e9r\u00eats pour le r\u00e9f\u00e9rencement de votre site. Parmi les \u00e9l\u00e9ments, vous pouvez d\u00e9cider de bloquer des PDF, les modes d\u2019affichages ou des rubriques du site qui ne doivent pas \u00eatre index\u00e9es.<\/p>\n<h2>Quel outil pour cr\u00e9er ce type de fichier\u00a0?<\/h2>\n<p>Un \u00e9diteur de texte comme le bloc note ou notepad est un outil tr\u00e8s largement suffisant pour \u00e9diter un robots.txt. Lors de l\u2019enregistrement de votre fichier, n\u2019omettez pas le S \u00e0 la fin de robots.<\/p>\n<h2>Quelques outils utiles \u2026<\/h2>\n<p>Comme pour de nombreux fichiers, il existe des g\u00e9n\u00e9rateurs de robots.txt. Je peux vous citer par exemple\u00a0:<\/p>\n<ul>\n<li><a href=\"http:\/\/tools.seobook.com\/robots-txt\/generator\/\" target=\"_blank\" rel=\"noopener noreferrer\">http:\/\/tools.seobook.com\/robots-txt\/generator\/<\/a><\/li>\n<li>http:\/\/outils-seo.info\/generateur-de-fichier-robots-txt<\/li>\n<li>https:\/\/smallseotools.com\/robots-txt-generator\/<\/li>\n<li>&#8230;<\/li>\n<\/ul>\n<p>Afin de tester votre fichier, Google Search Console vous propose un outil\u00a0:\u00a0<a href=\"https:\/\/accounts.google.com\/v3\/signin\/identifier?dsh=S1426522541%3A1679285281067134&amp;continue=https%3A%2F%2Fwww.google.com%2Fwebmasters%2Ftools%2Frobots-testing-tool%3Fhl%3Dfr&amp;followup=https%3A%2F%2Fwww.google.com%2Fwebmasters%2Ftools%2Frobots-testing-tool%3Fhl%3Dfr&amp;hl=fr&amp;ifkv=AWnogHc_hnGK0L4sLLeEXiwHS7OBJTW0vPyQ-UCeWXWjPIaekbWkD2MtzRSULXUZ4cDfpa6Cmpwd&amp;passive=1209600&amp;service=sitemaps&amp;flowName=GlifWebSignIn&amp;flowEntry=ServiceLogin\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/www.google.com\/webmasters\/tools\/robots-testing-tool?hl=fr<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Vous avez tr\u00e8s certainement \u00e0 un moment ou un autre entendu parler de loin ou de pr\u00e8s du fichier robots.txt. A quoi sert ce fichier &hellip; <\/p>\n","protected":false},"author":2,"featured_media":13471,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":""},"categories":[27],"tags":[166],"class_list":["post-13470","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-logiciels","tag-robots"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v21.9.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Le fichier robots.txt, c\u2019est quoi ? - Labo JNG WEB<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/jng-web.com\/labo\/fichier-robots-txt-cest-quoi\/\" \/>\n<meta property=\"og:locale\" content=\"fr_FR\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Le fichier robots.txt, c\u2019est quoi ? - Labo JNG WEB\" \/>\n<meta property=\"og:description\" content=\"Vous avez tr\u00e8s certainement \u00e0 un moment ou un autre entendu parler de loin ou de pr\u00e8s du fichier robots.txt. A quoi sert ce fichier &hellip;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/jng-web.com\/labo\/fichier-robots-txt-cest-quoi\/\" \/>\n<meta property=\"og:site_name\" content=\"Labo JNG WEB\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/webmaster.referencement.dijon\" \/>\n<meta property=\"article:author\" content=\"https:\/\/fr-fr.facebook.com\/JNGWEB.webmaster\" \/>\n<meta property=\"article:published_time\" content=\"2017-12-26T08:16:19+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-03-22T20:38:20+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/jng-web.com\/labo\/wp-content\/uploads\/2017\/12\/Robots.png\" \/>\n\t<meta property=\"og:image:width\" content=\"713\" \/>\n\t<meta property=\"og:image:height\" content=\"552\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"J\u00e9r\u00f4me\" \/>\n<meta name=\"twitter:label1\" content=\"\u00c9crit par\" \/>\n\t<meta name=\"twitter:data1\" content=\"J\u00e9r\u00f4me\" \/>\n\t<meta name=\"twitter:label2\" content=\"Dur\u00e9e de lecture estim\u00e9e\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/jng-web.com\/labo\/fichier-robots-txt-cest-quoi\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/jng-web.com\/labo\/fichier-robots-txt-cest-quoi\/\"},\"author\":{\"name\":\"J\u00e9r\u00f4me\",\"@id\":\"https:\/\/jng-web.com\/labo\/#\/schema\/person\/8dceaae857bc9738baa63b3d19fb4590\"},\"headline\":\"Le fichier robots.txt, c\u2019est quoi ?\",\"datePublished\":\"2017-12-26T08:16:19+00:00\",\"dateModified\":\"2023-03-22T20:38:20+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/jng-web.com\/labo\/fichier-robots-txt-cest-quoi\/\"},\"wordCount\":328,\"commentCount\":1,\"publisher\":{\"@id\":\"https:\/\/jng-web.com\/labo\/#organization\"},\"keywords\":[\"robots\"],\"articleSection\":[\"Logiciels\"],\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/jng-web.com\/labo\/fichier-robots-txt-cest-quoi\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/jng-web.com\/labo\/fichier-robots-txt-cest-quoi\/\",\"url\":\"https:\/\/jng-web.com\/labo\/fichier-robots-txt-cest-quoi\/\",\"name\":\"Le fichier robots.txt, c\u2019est quoi ? - Labo JNG WEB\",\"isPartOf\":{\"@id\":\"https:\/\/jng-web.com\/labo\/#website\"},\"datePublished\":\"2017-12-26T08:16:19+00:00\",\"dateModified\":\"2023-03-22T20:38:20+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/jng-web.com\/labo\/fichier-robots-txt-cest-quoi\/#breadcrumb\"},\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/jng-web.com\/labo\/fichier-robots-txt-cest-quoi\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/jng-web.com\/labo\/fichier-robots-txt-cest-quoi\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Labo Jng Web\",\"item\":\"https:\/\/jng-web.com\/labo\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Logiciels\",\"item\":\"https:\/\/jng-web.com\/labo\/logiciels\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Le fichier robots.txt, c\u2019est quoi ?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/jng-web.com\/labo\/#website\",\"url\":\"https:\/\/jng-web.com\/labo\/\",\"name\":\"Labo JNG WEB\",\"description\":\"R\u00e9f\u00e9rencement, Webmastering, CMS, Logiciels ...\",\"publisher\":{\"@id\":\"https:\/\/jng-web.com\/labo\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/jng-web.com\/labo\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"fr-FR\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/jng-web.com\/labo\/#organization\",\"name\":\"JNG WEB \/\/ J\u00e9r\u00f4me Guri\",\"url\":\"https:\/\/jng-web.com\/labo\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"https:\/\/jng-web.com\/labo\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/jng-web.com\/labo\/wp-content\/uploads\/2015\/04\/logo.png\",\"contentUrl\":\"https:\/\/jng-web.com\/labo\/wp-content\/uploads\/2015\/04\/logo.png\",\"width\":342,\"height\":110,\"caption\":\"JNG WEB \/\/ J\u00e9r\u00f4me Guri\"},\"image\":{\"@id\":\"https:\/\/jng-web.com\/labo\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/webmaster.referencement.dijon\",\"https:\/\/twitter.com\/jng_web\",\"https:\/\/fr.linkedin.com\/in\/jeromeguri\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/jng-web.com\/labo\/#\/schema\/person\/8dceaae857bc9738baa63b3d19fb4590\",\"name\":\"J\u00e9r\u00f4me\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"https:\/\/jng-web.com\/labo\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/21ca560712e7f1303d8c7c22d9ac9254b56517b653bfcb97d6736933471b2ea3?s=96&d=http%3A%2F%2Fwww.jng-web.com%2Flabo%2Fwp-content%2Fuploads%2F2013%2F12%2Favatar-blog-jng-web.png&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/21ca560712e7f1303d8c7c22d9ac9254b56517b653bfcb97d6736933471b2ea3?s=96&d=http%3A%2F%2Fwww.jng-web.com%2Flabo%2Fwp-content%2Fuploads%2F2013%2F12%2Favatar-blog-jng-web.png&r=g\",\"caption\":\"J\u00e9r\u00f4me\"},\"description\":\"Passionn\u00e9 par le web, je m'int\u00e9resse depuis quelques ann\u00e9es aux technologies de l'information et de la communication, et plus particuli\u00e8rement \u00e0 la cr\u00e9ation et au r\u00e9f\u00e9rencement de sites internet.\",\"sameAs\":[\"http:\/\/www.jng-web.com\",\"https:\/\/fr-fr.facebook.com\/JNGWEB.webmaster\",\"https:\/\/twitter.com\/JngWeb21\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Le fichier robots.txt, c\u2019est quoi ? - Labo JNG WEB","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/jng-web.com\/labo\/fichier-robots-txt-cest-quoi\/","og_locale":"fr_FR","og_type":"article","og_title":"Le fichier robots.txt, c\u2019est quoi ? - Labo JNG WEB","og_description":"Vous avez tr\u00e8s certainement \u00e0 un moment ou un autre entendu parler de loin ou de pr\u00e8s du fichier robots.txt. A quoi sert ce fichier &hellip;","og_url":"https:\/\/jng-web.com\/labo\/fichier-robots-txt-cest-quoi\/","og_site_name":"Labo JNG WEB","article_publisher":"https:\/\/www.facebook.com\/webmaster.referencement.dijon","article_author":"https:\/\/fr-fr.facebook.com\/JNGWEB.webmaster","article_published_time":"2017-12-26T08:16:19+00:00","article_modified_time":"2023-03-22T20:38:20+00:00","og_image":[{"width":713,"height":552,"url":"https:\/\/jng-web.com\/labo\/wp-content\/uploads\/2017\/12\/Robots.png","type":"image\/png"}],"author":"J\u00e9r\u00f4me","twitter_misc":{"\u00c9crit par":"J\u00e9r\u00f4me","Dur\u00e9e de lecture estim\u00e9e":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/jng-web.com\/labo\/fichier-robots-txt-cest-quoi\/#article","isPartOf":{"@id":"https:\/\/jng-web.com\/labo\/fichier-robots-txt-cest-quoi\/"},"author":{"name":"J\u00e9r\u00f4me","@id":"https:\/\/jng-web.com\/labo\/#\/schema\/person\/8dceaae857bc9738baa63b3d19fb4590"},"headline":"Le fichier robots.txt, c\u2019est quoi ?","datePublished":"2017-12-26T08:16:19+00:00","dateModified":"2023-03-22T20:38:20+00:00","mainEntityOfPage":{"@id":"https:\/\/jng-web.com\/labo\/fichier-robots-txt-cest-quoi\/"},"wordCount":328,"commentCount":1,"publisher":{"@id":"https:\/\/jng-web.com\/labo\/#organization"},"keywords":["robots"],"articleSection":["Logiciels"],"inLanguage":"fr-FR","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/jng-web.com\/labo\/fichier-robots-txt-cest-quoi\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/jng-web.com\/labo\/fichier-robots-txt-cest-quoi\/","url":"https:\/\/jng-web.com\/labo\/fichier-robots-txt-cest-quoi\/","name":"Le fichier robots.txt, c\u2019est quoi ? - Labo JNG WEB","isPartOf":{"@id":"https:\/\/jng-web.com\/labo\/#website"},"datePublished":"2017-12-26T08:16:19+00:00","dateModified":"2023-03-22T20:38:20+00:00","breadcrumb":{"@id":"https:\/\/jng-web.com\/labo\/fichier-robots-txt-cest-quoi\/#breadcrumb"},"inLanguage":"fr-FR","potentialAction":[{"@type":"ReadAction","target":["https:\/\/jng-web.com\/labo\/fichier-robots-txt-cest-quoi\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/jng-web.com\/labo\/fichier-robots-txt-cest-quoi\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Labo Jng Web","item":"https:\/\/jng-web.com\/labo\/"},{"@type":"ListItem","position":2,"name":"Logiciels","item":"https:\/\/jng-web.com\/labo\/logiciels\/"},{"@type":"ListItem","position":3,"name":"Le fichier robots.txt, c\u2019est quoi ?"}]},{"@type":"WebSite","@id":"https:\/\/jng-web.com\/labo\/#website","url":"https:\/\/jng-web.com\/labo\/","name":"Labo JNG WEB","description":"R\u00e9f\u00e9rencement, Webmastering, CMS, Logiciels ...","publisher":{"@id":"https:\/\/jng-web.com\/labo\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/jng-web.com\/labo\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"fr-FR"},{"@type":"Organization","@id":"https:\/\/jng-web.com\/labo\/#organization","name":"JNG WEB \/\/ J\u00e9r\u00f4me Guri","url":"https:\/\/jng-web.com\/labo\/","logo":{"@type":"ImageObject","inLanguage":"fr-FR","@id":"https:\/\/jng-web.com\/labo\/#\/schema\/logo\/image\/","url":"https:\/\/jng-web.com\/labo\/wp-content\/uploads\/2015\/04\/logo.png","contentUrl":"https:\/\/jng-web.com\/labo\/wp-content\/uploads\/2015\/04\/logo.png","width":342,"height":110,"caption":"JNG WEB \/\/ J\u00e9r\u00f4me Guri"},"image":{"@id":"https:\/\/jng-web.com\/labo\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/webmaster.referencement.dijon","https:\/\/twitter.com\/jng_web","https:\/\/fr.linkedin.com\/in\/jeromeguri"]},{"@type":"Person","@id":"https:\/\/jng-web.com\/labo\/#\/schema\/person\/8dceaae857bc9738baa63b3d19fb4590","name":"J\u00e9r\u00f4me","image":{"@type":"ImageObject","inLanguage":"fr-FR","@id":"https:\/\/jng-web.com\/labo\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/21ca560712e7f1303d8c7c22d9ac9254b56517b653bfcb97d6736933471b2ea3?s=96&d=http%3A%2F%2Fwww.jng-web.com%2Flabo%2Fwp-content%2Fuploads%2F2013%2F12%2Favatar-blog-jng-web.png&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/21ca560712e7f1303d8c7c22d9ac9254b56517b653bfcb97d6736933471b2ea3?s=96&d=http%3A%2F%2Fwww.jng-web.com%2Flabo%2Fwp-content%2Fuploads%2F2013%2F12%2Favatar-blog-jng-web.png&r=g","caption":"J\u00e9r\u00f4me"},"description":"Passionn\u00e9 par le web, je m'int\u00e9resse depuis quelques ann\u00e9es aux technologies de l'information et de la communication, et plus particuli\u00e8rement \u00e0 la cr\u00e9ation et au r\u00e9f\u00e9rencement de sites internet.","sameAs":["http:\/\/www.jng-web.com","https:\/\/fr-fr.facebook.com\/JNGWEB.webmaster","https:\/\/twitter.com\/JngWeb21"]}]}},"views":4670,"_links":{"self":[{"href":"https:\/\/jng-web.com\/labo\/wp-json\/wp\/v2\/posts\/13470","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/jng-web.com\/labo\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/jng-web.com\/labo\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/jng-web.com\/labo\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/jng-web.com\/labo\/wp-json\/wp\/v2\/comments?post=13470"}],"version-history":[{"count":0,"href":"https:\/\/jng-web.com\/labo\/wp-json\/wp\/v2\/posts\/13470\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/jng-web.com\/labo\/wp-json\/wp\/v2\/media\/13471"}],"wp:attachment":[{"href":"https:\/\/jng-web.com\/labo\/wp-json\/wp\/v2\/media?parent=13470"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/jng-web.com\/labo\/wp-json\/wp\/v2\/categories?post=13470"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/jng-web.com\/labo\/wp-json\/wp\/v2\/tags?post=13470"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}