<span style="font-weight: 400;">Imagine you are at home and you’re looking for a pen. You look for it everywhere, every nook and cranny, and have no luck in finding it. Finally, you give up and sit down, defeated. </span>

<span style="font-weight: 400;">Now imagine if there was a little magical spider in your room that crawled through your house every day, picking up small things and storing them in small boxes. Every box is named after a category and every object belonging to a category is placed in the right box. Now if you wanted a pen, you could just look into the box titled “stationery items”. Makes life so much easier right?</span>

<span style="font-weight: 400;">Well, this is kinda how Google works! Google has a bot that “crawls” through hundreds of thousands of websites every day. It then sends data back to Google and indexes those websites according to relevant keywords. Now, when you search for something, Google knows where to look. The easier it is for Google to do this, the better it is for your search engine results page ranking. There are a few things you can do to make crawling easy for Google.</span>

Before we move on to the topic, if you need help with ranking higher on search results, you should definitely talk to our talented SEO team. <a href="https://vividreal.com/hire-seo-gurus/">Talk to us today.</a>

<span style="color: #00ccff;"><b>Technical SEO</b></span>

<span style="font-weight: 400;">Technical SEO refers to improving the technical aspects of a site to ensure that search engine bots can crawl and index your site properly, thus giving it better rankings on a search engine’s results page.</span>
<ul>
 	<li><span style="color: #00ccff;"><b>Crawlability</b></span></li>
</ul>
<span style="font-weight: 400;">Crawlability is Google’s ability to “crawl” through different web pages by following the links on those pages, just like any site visitor would do. The web crawler (also called the spider) sends relevant information back to Google.</span>
<ul>
 	<li><span style="color: #00ccff;"><b>Indexability</b></span></li>
</ul>
<span style="font-weight: 400;">This is Google’s ability to index different web pages according to commonly searched, relevant keywords. This can’t happen if Google cannot crawl your site; nor is it guaranteed to happen if your site is indeed crawlable. Sounds complicated? Keep reading!</span>

<span style="color: #00ccff;"><b>Optimising your site for crawlability and indexability</b></span>

<span style="color: #00ccff;"><b>Website structure</b></span><span style="font-weight: 400;"> plays an important role in a site’s crawlability. If your web pages are not inter-linked properly, Google’s bots cannot access them. Google’s bots should be able to access every page on your site in 2 or 3 clicks. Be sure to remove any broken links as these will definitely affect the crawlability of your site. Looped redirects and linking mistakes are common problems that affect crawlability. </span>

<span style="font-weight: 400;">Web pages that are accessible only after submission of a form cannot be accessed by web crawlers. This can, however, be useful when you don’t want certain pages to appear on a search engine results page. This is also a great way of restricting public access to certain pages that might contain confidential information.</span>

<span style="color: #00ccff;"><b>How to improve crawlability?</b></span>

<span style="font-weight: 400;">There are a few steps you can take to improve the crawlability of your website. Some of them are mentioned below:</span>
<ol>
 	<li style="font-weight: 400;"><span style="color: #00ccff;"><b>Submitting a sitemap to Google.</b></span><span style="font-weight: 400;"> A sitemap is a small file located in the root folder of your domain that contains all the links of your webpage. There are tools like </span><a href="https://www.screamingfrog.co.uk/xml-sitemap-generator/"><span style="font-weight: 400;">Screaming Frog</span></a><span style="font-weight: 400;"> that you can use to create a sitemap for your website. If you have a Wordpress site, you can use plugins like </span><a href="https://wordpress.org/plugins/google-sitemap-generator/"><span style="font-weight: 400;">Google XML Sitemaps</span></a><span style="font-weight: 400;"> to create sitemaps. You can submit a sitemap to Google via the </span><a href="https://search.google.com/search-console/welcome"><span style="font-weight: 400;">Google Console</span></a><span style="font-weight: 400;">.</span></li>
 	<li style="font-weight: 400;"><span style="font-weight: 400;">As mentioned above, </span><span style="color: #00ccff;"><b>interlinking between webpages ensures smooth crawling</b></span><span style="font-weight: 400;"><span style="color: #00ccff;">.</span> Make sure that all the links on your webpage are working. Fix all broken links and redirects.</span></li>
 	<li style="font-weight: 400;"><span style="color: #00ccff;"><b>Web crawlers visit sites that are regularly updated.</b></span><span style="font-weight: 400;"> Regular content can attract more visitors, can give you a better ranking on a search engine’s results page and it can also ensure that your site is crawled and indexed much faster!</span></li>
 	<li style="font-weight: 400;"><span style="font-weight: 400;">Having the same content on different webpages, and having similar webpages on your site can also affect crawlability. Check for any duplicate content you may have on your website and fix it to improve crawlability.</span></li>
 	<li style="font-weight: 400;"><span style="font-weight: 400;">Google’s crawl bots have a time limit for their crawl duration.</span><span style="color: #00ccff;"><b> Web loading speeds matter</b></span><span style="font-weight: 400;"><span style="color: #00ccff;">.</span> Make sure your site loads fast. There are multiple free tools you can use to analyze your site speed on mobile devices as well as desktop computers. Google bots are only allowed to crawl a website for some amount of time before they move on to other sites. If you have a lot of 404 errors, or if you have a slow website, you might be wasting the bots’ time.</span></li>
 	<li style="font-weight: 400;"><span style="color: #00ccff;"><b>Structured Data</b></span><span style="font-weight: 400;"><span style="color: #00ccff;">.</span> Your site should contain structured data. Also known as Schema Markup, it makes it easier for Google to crawl your website, organize, and display your content. It is basically a code that enables search engines to understand your content better. Search engines also use structured data to display search results with more information. For example, a search result for a recipe can display the ratings for it, the number of people who have reviewed it and much more. </span></li>
 	<li style="font-weight: 400;"><span style="font-weight: 400;">A technically optimised website will have implemented HTTPS. Google recommends all websites to have a secure protocol. This makes the website secure and makes sure that nobody can intercept the data sent between the browser and the site. HTTP sites will also have lower rankings compared to HTTPS.</span></li>
 	<li style="font-weight: 400;"><span style="font-weight: 400;">Sharing links to your pages on social media is a great way of getting your site indexed. Google regularly indexes links posted on Twitter and other social media platforms. Sharing links on high-traffic sites like Reddit is also a great way of getting your site indexed, plus you get a lot of traffic too.</span></li>
</ol>
<span style="font-weight: 400;">If you’ve just launched your site, you may have to wait for a few weeks (maybe even a few months) for Google to index your site. You can speed this up by following the steps mentioned above. If you want to check whether Google has already indexed your website or not, simply search </span><span style="color: #00ccff;"><b>site:yourdomain.com</b></span><span style="font-weight: 400;"> and check if your site appears in the search results. If there are no results, it means Google hasn’t indexed your site yet.</span>

<span style="font-weight: 400;">In conclusion, crawlability and indexability are important if you want people to be able to find you on Google. Following the above steps will ensure that you get crawled and indexed regularly! For more SEO related help, <a href="https://vividreal.com/hire-seo-gurus/">talk to us</a>. We'd be more than glad to help.</span>