Banjo Hangout Logo
Banjo Hangout Logo

Premier Sponsors


Nov 15, 2026 - 10:36:35 PM

banjoy

USA

12083 posts since 7/1/2006

I have tried to get Eric's attention to this matter but this new math intercept is going to kill this website.

As I feared, Google is being actively blocked from indexing pages now and this is confirmed by google.

Normally, without this block, new threads and updated pages pages on this site are indexed by google within a few hours. Now, since the incept block, google cannot access these pages to index them, and new threads created since that time, and ALL current pages on BHO are not being crawled any more. New threads no do not show up at all, and existing threads will drop off the google index within a month or so if they cannot be crawled. So soon, BHO will disappear from google entirely.

Google provides a simple way to check this. Copy and paste a URL for any page on this website, whether new or old, all are being blocked. So I picked several threads that were started new in the last week. I also tested threads which were created months ago. NOT ONE OF THEM IS BEING INDEXED NOW.

Here is a site for developers to test whether google is indexing. So select any thread created since the new AI block, and you can confirm this is bad. Paste a recent thread link to this test page:

https://search.google.com/test/rich-results

And the result is: "URL is not available to Google It cannot be tested. " This test fails for every URL on this website. All since the AI intercept. Not good.

Here is my latest google AI chat which tells why google is blocked and how to fix it.

https://share.google/aimode/opzFFd8Vn4qTubyp1

Eric, this needs your immediate attention.
 

Edited by - banjoy on 11/16/2026 04:49:30

Nov 15, 2026 - 10:43:34 PM
Players Union Member

schlange (Administrator)

USA

6202 posts since 1/20/2003

I’ll check it out. I had white listed Google’s bot, so this is odd…

Nov 15, 2026 - 10:49:05 PM

banjoy

USA

12083 posts since 7/1/2006

Thanks for responding! I have found google AI to be somewhat useful when discussing google issues. Perhaps you can engage in chat with google AI and identify yourself as administrator, it seems helpful in these instances.

I'm rooting for you for sure. I cannot imagine being in your shoes. Any further alerts from me will be in private, I think you have enough on your plate. If I can help in any way I will try.

Thanks Eric.

Nov 15, 2026 - 11:05:50 PM

banjoy

USA

12083 posts since 7/1/2006

I just sent you another email to the revised google AI chat. More info included in that revised link, no need to post it here.

Thanks Eric. Seriously!

Nov 16, 2026 - 1:02:12 AM
like this

57 posts since 7/29/2026

One of the problems I'm noticing as LLM use becomes more widespread is the tendency for users to take on the LLM's hubris.

That page doesn't test crawl-ability, or indexing. Eric has much more accurate tools to assess those anyway should he wish.

It almost certainly uses a different user agent than a normal indexing bot so it is treated differently. Trusting a user agent alone is a terrible idea as these are very easily spoofed, I do it all the time.

It did report that it was blocked by robots.txt, which was bunk, but likely just a default message.I've encountered that many other times with googles more arcane tools. Robots.txt is very standardized and visible here: banjohangout.org/robots.txt

And is not blocking the url I tested.

To be clear, it is possible that Google's crawlers are being blocked, but none of this is evidence of that

FWIW I am a systems engineer at a fairly large company and deal with these sorts of things daily. I do have very real practical experience on stuff just like dealing with millions of sophisticated crawls from malicious actors per day while simultaneously improving accessibility to honest bots. When I do make mistakes at work it's measured in thousands of $$ per minute, and I do get paid well for what I do. I'm not just trying to brag, Im just establishing credibility above "an LLM told me so"

I've declined to chime in previously as normally I require a mutual NDA, $75/hour, and a minimum of four hours for consulting work.

Nov 16, 2026 - 3:43:09 AM

RB-1

Netherlands

4396 posts since 6/17/2003

To me, staying out of Google's claws is something positive,,,,, cheeky

Nov 16, 2026 - 4:18:43 AM

banjoy

USA

12083 posts since 7/1/2006

I continued the chat with AI after the link I posted above, and I am well aware of robots.txt file -- of course that allows google in, the very first line specifically allows all user-agents. Robots.txt is not the problem, and is an archaic first line of defense. Last night I had google AI check the robots.txt file to be sure, but anyone can read it it's easy to understand. That's not the issue. The issue appears to be google is not represented in the server's firewall whitelist, the last line of defense.

Google is blocked. You can check any URL on this website and it returns the same error, including the home page. I was able to establish that threads created months and years ago are no longer crawl-able, either by googlebot or  Google-InspectionTool (both google crawlers). 

As far as the value of google indexing, without it no one can find this website through internet searches. Traffic affects ad revenue. Ad revenue affects whether we have a website to visit at all. So yes, it's good to be in the google index.

Bing's search crawler is apparently blocked, too btw, but I can only test so deep not being the webmaster. Here is a link that Eric can use to confirm Bing's indexing, but he has to confirm his role as webmaster first to have access to the tool:

https://www.bing.com/webmasters/help/url-inspection-55a30305 

Edited by - banjoy on 11/16/2026 04:26:18

Nov 16, 2026 - 4:32:21 AM

banjoy

USA

12083 posts since 7/1/2006

For example, here is the test results for a thread that has been live and active on BHO since 2022.


Nov 16, 2026 - 5:42:18 AM
likes this

57 posts since 7/29/2026

Something about leading horses to water...


In my post I pointed out that tool is not using the same bot as search scrapers. The results there are not terribly concerning. Google search console is available to Eric and he can verify things much more accurately than you or I can.

I can see recent posts coming up in search results.


 

Terms of Use | Privacy Policy | Privacy Consent (EU/GDPR Only)

Copyright 2026 Banjo Hangout. All Rights Reserved.





Hangout Network Help

View All Topics  |  View Categories

0.2609863