{"id":423,"date":"2017-06-15T21:35:14","date_gmt":"2017-06-15T21:35:14","guid":{"rendered":"http:\/\/insurancewebsitebible.com\/articles\/?p=423"},"modified":"2017-07-04T02:22:33","modified_gmt":"2017-07-04T02:22:33","slug":"robots-txt","status":"publish","type":"post","link":"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/","title":{"rendered":"Publish a Robots.txt File"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"alignright wp-image-609 size-full\" src=\"http:\/\/insurancewebsitebible.com\/articles\/wp-content\/uploads\/2017\/06\/robot-txt.png\" alt=\"\" width=\"200\" height=\"200\" srcset=\"http:\/\/insurancewebsitebible.com\/articles\/wp-content\/uploads\/2017\/06\/robot-txt.png 200w, http:\/\/insurancewebsitebible.com\/articles\/wp-content\/uploads\/2017\/06\/robot-txt-150x150.png 150w\" sizes=\"auto, (max-width: 200px) 100vw, 200px\" \/>A robots.txt file goes on your website\u2019s server and grants search engine robots permission to get to parts of your website. I\u2019m not sure Google\u2019s going to change your rankings based on having this or not but it\u2019s easy to setup and having a robots.txt file is considered good practice for SEO.<\/p>\n<h2>Helpful Resources:<\/h2>\n<ul>\n<li><a href=\"http:\/\/tools.seobook.com\/robots-txt\/generator\/\">Robots.txt File Generator<\/a><\/li>\n<li><a href=\"http:\/\/www.insurancesplash.com\/websites\">Insurance Websites That Come with Robots.txt Files Standard<\/a><\/li>\n<li><a href=\"http:\/\/www.insurancesplash.com\/insurance-seo\">Search Engine Optimization Services for Insurance Agents<\/a><\/li>\n<li><a href=\"http:\/\/www.insurancesplash.com\/online-ads\">Online PPC Ads for Insurance<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>A robots.txt file goes on your website\u2019s server and grants search engine robots permission to get to parts of your website. I\u2019m not sure Google\u2019s going to change your rankings based on having this or not but it\u2019s easy to setup and having a robots.txt file is considered good practice for SEO. Helpful Resources: Robots.txt &hellip; <a href=\"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">Publish a Robots.txt File<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":424,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":""},"categories":[6],"tags":[],"class_list":["post-423","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-search-engine-optimization"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.2 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Publish a Robots.txt File - Insurance Website Marketing Bible<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Publish a Robots.txt File - Insurance Website Marketing Bible\" \/>\n<meta property=\"og:description\" content=\"A robots.txt file goes on your website\u2019s server and grants search engine robots permission to get to parts of your website. I\u2019m not sure Google\u2019s going to change your rankings based on having this or not but it\u2019s easy to setup and having a robots.txt file is considered good practice for SEO. Helpful Resources: Robots.txt &hellip; Continue reading Publish a Robots.txt File\" \/>\n<meta property=\"og:url\" content=\"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/\" \/>\n<meta property=\"og:site_name\" content=\"Insurance Website Marketing Bible\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/insurancesplash\" \/>\n<meta property=\"article:published_time\" content=\"2017-06-15T21:35:14+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2017-07-04T02:22:33+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/insurancewebsitebible.com\/articles\/wp-content\/uploads\/2017\/06\/publish-a-robots-txt-file.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"825\" \/>\n\t<meta property=\"og:image:height\" content=\"510\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"John\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@insurancesplash\" \/>\n<meta name=\"twitter:site\" content=\"@insurancesplash\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"John\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/#article\",\"isPartOf\":{\"@id\":\"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/\"},\"author\":{\"name\":\"John\",\"@id\":\"http:\/\/insurancewebsitebible.com\/articles\/#\/schema\/person\/1ddfabccf34da5a67b859f5b9e8bad99\"},\"headline\":\"Publish a Robots.txt File\",\"datePublished\":\"2017-06-15T21:35:14+00:00\",\"dateModified\":\"2017-07-04T02:22:33+00:00\",\"mainEntityOfPage\":{\"@id\":\"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/\"},\"wordCount\":90,\"commentCount\":0,\"publisher\":{\"@id\":\"http:\/\/insurancewebsitebible.com\/articles\/#organization\"},\"image\":{\"@id\":\"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/#primaryimage\"},\"thumbnailUrl\":\"http:\/\/insurancewebsitebible.com\/articles\/wp-content\/uploads\/2017\/06\/publish-a-robots-txt-file.jpg\",\"articleSection\":[\"Search Engine Optimization\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/\",\"url\":\"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/\",\"name\":\"Publish a Robots.txt File - Insurance Website Marketing Bible\",\"isPartOf\":{\"@id\":\"http:\/\/insurancewebsitebible.com\/articles\/#website\"},\"primaryImageOfPage\":{\"@id\":\"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/#primaryimage\"},\"image\":{\"@id\":\"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/#primaryimage\"},\"thumbnailUrl\":\"http:\/\/insurancewebsitebible.com\/articles\/wp-content\/uploads\/2017\/06\/publish-a-robots-txt-file.jpg\",\"datePublished\":\"2017-06-15T21:35:14+00:00\",\"dateModified\":\"2017-07-04T02:22:33+00:00\",\"breadcrumb\":{\"@id\":\"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/#primaryimage\",\"url\":\"http:\/\/insurancewebsitebible.com\/articles\/wp-content\/uploads\/2017\/06\/publish-a-robots-txt-file.jpg\",\"contentUrl\":\"http:\/\/insurancewebsitebible.com\/articles\/wp-content\/uploads\/2017\/06\/publish-a-robots-txt-file.jpg\",\"width\":825,\"height\":510},{\"@type\":\"BreadcrumbList\",\"@id\":\"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"http:\/\/insurancewebsitebible.com\/articles\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Publish a Robots.txt File\"}]},{\"@type\":\"WebSite\",\"@id\":\"http:\/\/insurancewebsitebible.com\/articles\/#website\",\"url\":\"http:\/\/insurancewebsitebible.com\/articles\/\",\"name\":\"Insurance Website Marketing Bible\",\"description\":\"\",\"publisher\":{\"@id\":\"http:\/\/insurancewebsitebible.com\/articles\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"http:\/\/insurancewebsitebible.com\/articles\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"http:\/\/insurancewebsitebible.com\/articles\/#organization\",\"name\":\"InsuranceSplash, LLC\",\"url\":\"http:\/\/insurancewebsitebible.com\/articles\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"http:\/\/insurancewebsitebible.com\/articles\/#\/schema\/logo\/image\/\",\"url\":\"http:\/\/insurancewebsitebible.com\/articles\/wp-content\/uploads\/2017\/06\/insurancesplash-square-1200-1200-adwords.png\",\"contentUrl\":\"http:\/\/insurancewebsitebible.com\/articles\/wp-content\/uploads\/2017\/06\/insurancesplash-square-1200-1200-adwords.png\",\"width\":1200,\"height\":1200,\"caption\":\"InsuranceSplash, LLC\"},\"image\":{\"@id\":\"http:\/\/insurancewebsitebible.com\/articles\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/insurancesplash\",\"https:\/\/x.com\/insurancesplash\",\"https:\/\/www.linkedin.com\/company\/insurancesplash\",\"http:\/\/www.pinterest.com\/insurancesplash\/\",\"http:\/\/www.youtube.com\/insurancesplash\"]},{\"@type\":\"Person\",\"@id\":\"http:\/\/insurancewebsitebible.com\/articles\/#\/schema\/person\/1ddfabccf34da5a67b859f5b9e8bad99\",\"name\":\"John\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/secure.gravatar.com\/avatar\/52baa141f98510b1680944579e3d125046f4a0c2e435b74a481d7bb393e16351?s=96&d=mm&r=g\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/52baa141f98510b1680944579e3d125046f4a0c2e435b74a481d7bb393e16351?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/52baa141f98510b1680944579e3d125046f4a0c2e435b74a481d7bb393e16351?s=96&d=mm&r=g\",\"caption\":\"John\"},\"sameAs\":[\"http:\/\/www.insurancesplash.com\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Publish a Robots.txt File - Insurance Website Marketing Bible","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/","og_locale":"en_US","og_type":"article","og_title":"Publish a Robots.txt File - Insurance Website Marketing Bible","og_description":"A robots.txt file goes on your website\u2019s server and grants search engine robots permission to get to parts of your website. I\u2019m not sure Google\u2019s going to change your rankings based on having this or not but it\u2019s easy to setup and having a robots.txt file is considered good practice for SEO. Helpful Resources: Robots.txt &hellip; Continue reading Publish a Robots.txt File","og_url":"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/","og_site_name":"Insurance Website Marketing Bible","article_publisher":"https:\/\/www.facebook.com\/insurancesplash","article_published_time":"2017-06-15T21:35:14+00:00","article_modified_time":"2017-07-04T02:22:33+00:00","og_image":[{"width":825,"height":510,"url":"http:\/\/insurancewebsitebible.com\/articles\/wp-content\/uploads\/2017\/06\/publish-a-robots-txt-file.jpg","type":"image\/jpeg"}],"author":"John","twitter_card":"summary_large_image","twitter_creator":"@insurancesplash","twitter_site":"@insurancesplash","twitter_misc":{"Written by":"John"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/#article","isPartOf":{"@id":"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/"},"author":{"name":"John","@id":"http:\/\/insurancewebsitebible.com\/articles\/#\/schema\/person\/1ddfabccf34da5a67b859f5b9e8bad99"},"headline":"Publish a Robots.txt File","datePublished":"2017-06-15T21:35:14+00:00","dateModified":"2017-07-04T02:22:33+00:00","mainEntityOfPage":{"@id":"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/"},"wordCount":90,"commentCount":0,"publisher":{"@id":"http:\/\/insurancewebsitebible.com\/articles\/#organization"},"image":{"@id":"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/#primaryimage"},"thumbnailUrl":"http:\/\/insurancewebsitebible.com\/articles\/wp-content\/uploads\/2017\/06\/publish-a-robots-txt-file.jpg","articleSection":["Search Engine Optimization"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/#respond"]}]},{"@type":"WebPage","@id":"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/","url":"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/","name":"Publish a Robots.txt File - Insurance Website Marketing Bible","isPartOf":{"@id":"http:\/\/insurancewebsitebible.com\/articles\/#website"},"primaryImageOfPage":{"@id":"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/#primaryimage"},"image":{"@id":"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/#primaryimage"},"thumbnailUrl":"http:\/\/insurancewebsitebible.com\/articles\/wp-content\/uploads\/2017\/06\/publish-a-robots-txt-file.jpg","datePublished":"2017-06-15T21:35:14+00:00","dateModified":"2017-07-04T02:22:33+00:00","breadcrumb":{"@id":"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/#primaryimage","url":"http:\/\/insurancewebsitebible.com\/articles\/wp-content\/uploads\/2017\/06\/publish-a-robots-txt-file.jpg","contentUrl":"http:\/\/insurancewebsitebible.com\/articles\/wp-content\/uploads\/2017\/06\/publish-a-robots-txt-file.jpg","width":825,"height":510},{"@type":"BreadcrumbList","@id":"http:\/\/insurancewebsitebible.com\/articles\/robots-txt\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"http:\/\/insurancewebsitebible.com\/articles\/"},{"@type":"ListItem","position":2,"name":"Publish a Robots.txt File"}]},{"@type":"WebSite","@id":"http:\/\/insurancewebsitebible.com\/articles\/#website","url":"http:\/\/insurancewebsitebible.com\/articles\/","name":"Insurance Website Marketing Bible","description":"","publisher":{"@id":"http:\/\/insurancewebsitebible.com\/articles\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"http:\/\/insurancewebsitebible.com\/articles\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"http:\/\/insurancewebsitebible.com\/articles\/#organization","name":"InsuranceSplash, LLC","url":"http:\/\/insurancewebsitebible.com\/articles\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"http:\/\/insurancewebsitebible.com\/articles\/#\/schema\/logo\/image\/","url":"http:\/\/insurancewebsitebible.com\/articles\/wp-content\/uploads\/2017\/06\/insurancesplash-square-1200-1200-adwords.png","contentUrl":"http:\/\/insurancewebsitebible.com\/articles\/wp-content\/uploads\/2017\/06\/insurancesplash-square-1200-1200-adwords.png","width":1200,"height":1200,"caption":"InsuranceSplash, LLC"},"image":{"@id":"http:\/\/insurancewebsitebible.com\/articles\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/insurancesplash","https:\/\/x.com\/insurancesplash","https:\/\/www.linkedin.com\/company\/insurancesplash","http:\/\/www.pinterest.com\/insurancesplash\/","http:\/\/www.youtube.com\/insurancesplash"]},{"@type":"Person","@id":"http:\/\/insurancewebsitebible.com\/articles\/#\/schema\/person\/1ddfabccf34da5a67b859f5b9e8bad99","name":"John","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/52baa141f98510b1680944579e3d125046f4a0c2e435b74a481d7bb393e16351?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/52baa141f98510b1680944579e3d125046f4a0c2e435b74a481d7bb393e16351?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/52baa141f98510b1680944579e3d125046f4a0c2e435b74a481d7bb393e16351?s=96&d=mm&r=g","caption":"John"},"sameAs":["http:\/\/www.insurancesplash.com"]}]}},"_links":{"self":[{"href":"http:\/\/insurancewebsitebible.com\/articles\/wp-json\/wp\/v2\/posts\/423","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/insurancewebsitebible.com\/articles\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/insurancewebsitebible.com\/articles\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/insurancewebsitebible.com\/articles\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/insurancewebsitebible.com\/articles\/wp-json\/wp\/v2\/comments?post=423"}],"version-history":[{"count":5,"href":"http:\/\/insurancewebsitebible.com\/articles\/wp-json\/wp\/v2\/posts\/423\/revisions"}],"predecessor-version":[{"id":891,"href":"http:\/\/insurancewebsitebible.com\/articles\/wp-json\/wp\/v2\/posts\/423\/revisions\/891"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/insurancewebsitebible.com\/articles\/wp-json\/wp\/v2\/media\/424"}],"wp:attachment":[{"href":"http:\/\/insurancewebsitebible.com\/articles\/wp-json\/wp\/v2\/media?parent=423"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/insurancewebsitebible.com\/articles\/wp-json\/wp\/v2\/categories?post=423"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/insurancewebsitebible.com\/articles\/wp-json\/wp\/v2\/tags?post=423"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}