This is a bit of a strange one, I have recently been using Google Chrome Lighthouse v3 and noticed that under the SEO check it reports that the ‘Page is blocked from indexing’The report also shows that the Blocking Directive Source is /robots.txt
I have removed the following from the webpages, as after a bit of reading I found that these settings are not really needed, unless a webpage is to be not indexed or not followed.
<meta name="robots" content="index, follow">
Looking through Google Search Console, it shows that the webpages are being indexed, and all the pages can be viewed using site:www.mywebsite.co.uk
What’s going on, any ideas what is causing the Lighthouse report to show the ‘Page is blocked from indexing’.
After some consideration reading posts on here I figured a good basic list of resources would be good. Not sure if a mod will lock this so it can be updated at a later date, might be nice to stop the "what is this SEO" type posts but any other peeps using with GOOD tools feel free to chip in.
The Beginners Guide to SEO - Moz
Read this! And before asking anything, read this! Seriously, read it; covers everything from how search engines work to tracking success. 90% of your questions will be answered before asking anything.
Search Engine Optimization (SEO) Starter Guide - Google
PageSpeed Insights - Google
Yes, site speed is a factor, no quantity of keywords will fix these, this is 'SEO'.
Microdata - Schema
Mixed debate, personal favourite of mine, if nothing else have cool breadcrumbs under your listing.
Structured Data Testing Tool - Google
See what Google picks up from your structured data and clarify errors.
HTTP / HTTPS Header Check
A great way to see if the supposed 301 is real or if you're giving 302s instead.
Similar but also checks the number of redirects.
Learn SEO - Moz
Freaking great set of resources. If you're still stuffing keywords into titles and descriptions then you need to start here!
Canonical vs NoIndex - Moz
Yup, another Moz post but before thinking Canonical is a silver bullet read this.
XML Sitemaps: The Most Misunderstood Tool in the SEO's Toolbox - Michael Cottam, Moz
Worth a read, especially the consistency section.
News & Rumours
Google Algorithm Change History - Moz
Google PageRank & Algorithm Updates - Search Engine Roundtable
I subscribe to this guy's email list. According to him, Google will begin using the mobile version of a page for search engine results, even if the search is performed on a desktop.
This could bring a lot of business my way, in terms of making sites mobile friendly. But I'm not a fan of Google dictating to the world how to create their websites. If this is true, then sites that are not mobile-friendly will disappear from search engine results pages.
I use Bing myself, but obviously most people still use Google.