Shaikat Ray

You see this in GSC. Do you:
a) forward a screenshot to the dev team and ask WTF,
b) use noindex directive,
c) block the pages in robots.txt,
d) or all of the above?

If you read @shaikatray.com's recent article for us, you got this.

Improving Crawling & Indexing with Noindex, Robots.txt & Rel Attributes | Sitebulb Shaikat Ray walks us through how to improve your page crawling and indexing using noindex, robots.txt and rel attributes.

🔥TUESDAY TACTICS!🔥
@shaikatray.com explains how to use data from GSC to improve crawling & indexing for your website using:

💡 Noindex robots directive 
💡 Rules on robots.txt
💡 Rel="canonical" attribute
💡 Rel="nofollow" attribute

#seo

sitebulb.com/resources/gu...

@johnmu.com Sorry, I am not trying to get the XML sitemap indexed. I was inspecting a URL, and the inspected URL is listed in the XML sitemap.

But, I was wondering why the compressed XML sitemap was not listed under Sitemap, rather it's listed as a page in the discovery source. Thanks!

SEO is fun, especially the technical side of it. At Self Canonical, we live and breathe technical SEO. Let’s talk about your project and make it thrive.

✅ selfcanonical.com

#technicalseo #selfcanonical #shaikatray

DisallowAITraining and AllowAITraining - Robots AI Control Well, we’re going to have another means to prevent AI bots from training on our content. On 21 October, 2024, Fabrice Canel and Krishna Madhavan proposed two new Robots Control Rules to IETF - https:/...

Well, we’re going to have another means to prevent AI bots from training on our content. On 21 October, 2024, Fabrice Canel and Krishna Madhavan proposed two new Robots Control Rules to IETF.

www.linkedin.com/pulse/disall...