Article

Meng Lin
Meng Lin 31 January 2020

Why Can't You Find Your Website On Google?

Trying to figure out why your website isn’t appearing on Google? This short checklist will help Google find your site!

Have you tried searching for your website on Google and couldn’t find it? There’s a good chance that Google can’t find and index your website, which is a nightmare for SEO.

So why can’t Google find your site? Here’s a checklist to find the problem and possibly fix the issue. 

1. Wordpress Settings

Check to make sure WordPress isn’t blocking search engines from indexing your site

Login to your WordPress site, and make sure the Search Engine Visibility box is unticked:

2. Robots Meta Tag

The robots meta tag is a piece of code that is placed in the header of your pages.

If you right click on the page that can’t be found on Google, and click “View Page Source” – look for this particular code:

<meta name=”robots” content=”noindex,follow”/>

If you see the noindex, then you need to get your web developer to change it to index instead.

3. XML Sitemap

When you add a new page to your website, make sure that it gets added to your sitemap.

An XML sitemap is like a directory of all the pages of your website that gives search engines a listing of all your pages.

You can check your XML sitemap by going to www.yourwebsite.com.au/sitemap.xml

4. Robots.text File

The robots.txt file tells web robots which pages to crawl (and not crawl) on your website.

The robots.txt file also allows you to only allow specific bots to crawl your site and disallow others. To check your own robots.txt file – go to www.yourwebsite.com.au/robots.txt

The default robots.txt file for WordPress sites should look like this:

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php


Bonus tip: Test your robots.txt file

Google offers a robots.txt file tester which you can use here: Robots.txt tester tool

You can put in any page from your website to see if Googlebot will be able to crawl that page:

If you see this:

Talk to your web developer about your robots.txt file, and check with your hosting provider to make sure that they haven’t blocked Googlebot’s IP addresses.

Please login or register to add a comment.

Contribute Now!

Loving our articles? Do you have an insightful post that you want to shout about? Well, you've come to the right place! We are always looking for fresh Doughnuts to be a part of our community.

Popular Articles

See all
The Impact of New Technology on Marketing

The Impact of New Technology on Marketing

Technology has impacted every part of our lives. From household chores to business disciplines and etiquette, there's a gadget or app for it. Marketing has changed dramatically over the years, but what is the...

Alex Lysak
Alex Lysak 3 April 2024
Read more
How to Review a Website — A Guide for Beginners

How to Review a Website — A Guide for Beginners

A company website is crucial for any business's digital marketing strategy. To keep up with the changing trends and customer buying behaviors, it's important to review and make necessary changes regularly...

Digital Doughnut Contributor
Digital Doughnut Contributor 25 March 2024
Read more
5 Key Findings from The State of B2B Content for Growth Marketing

5 Key Findings from The State of B2B Content for Growth Marketing

B2B marketers are trying harder than ever to get a decent return on their content investment. Based on a survey of 350 B2B organizations, a new research report from Demand Exchange and London Research looks at the...

Linus Gregoriadis
Linus Gregoriadis 5 September 2024
Read more
Sales and Marketing Collaboration: A Recipe for B2B Success

Sales and Marketing Collaboration: A Recipe for B2B Success

In the world of B2B, the age-old rivalry between Sales and Marketing often overshadows the potential for a fruitful partnership. Yet, when these two departments align their goals, strategies, and efforts, the results...

Zsofia Raffa
Zsofia Raffa 12 September 2024
Read more
10 Factors that Influence Customer Buying Behaviour Online

10 Factors that Influence Customer Buying Behaviour Online

Now is an era where customers take the center stags influencing business strategies across industries. No business can afford to overlook factors that could either break the customer experience or even pose a risk of...

Edward Roesch
Edward Roesch 4 June 2018
Read more