Geekzone: technology news, blogs, forums
Guest
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.


Behodar

11094 posts

Uber Geek
+1 received by user: 6071

Trusted
Lifetime subscriber

#298804 18-Jul-2022 08:22
Send private message

Morning,

 

We have a couple of test pages on our site which aren't shown in the navigation and don't appear in the site map. They're not linked from anywhere and you need to know the direct URLs to get to them.

 

Despite that, they've somehow ended up in the Google search index. Does anyone know whether there's a way to find out how Google got its mitts on the pages? If they're not linked from anywhere then how in the world does Google know they exist?


Create new topic
RunningMan
9184 posts

Uber Geek
+1 received by user: 4834


  #2943285 18-Jul-2022 08:39
Send private message

Harvested from a link sent to/from a gmail address?




michaelmurfy
meow
13579 posts

Uber Geek
+1 received by user: 10910

Moderator
ID Verified
Trusted
Lifetime subscriber

  #2943288 18-Jul-2022 08:48
Send private message

Does anyone who accessed these pages use Google Chrome?




Michael Murphy | https://murfy.nz
Referral Links: Quic Broadband (use R122101E7CV7Q for free setup)

Are you happy with what you get from Geekzone? Please consider supporting us by subscribing.
Opinions are my own and not the views of my employer.


freitasm
BDFL - Memuneh
80646 posts

Uber Geek
+1 received by user: 41030

Administrator
ID Verified
Trusted
Geekzone
Lifetime subscriber

  #2943292 18-Jul-2022 08:54
Send private message

Are you using Cloudflare? 





Referral links: Quic Broadband (free setup code: R587125ERQ6VE) | Samsung | AliExpress | Wise | Sharesies 

 

Support Geekzone by subscribing (browse ads-free), or making a one-off or recurring donation through PressPatron.

 




Behodar

11094 posts

Uber Geek
+1 received by user: 6071

Trusted
Lifetime subscriber

  #2943294 18-Jul-2022 08:58
Send private message

Just to clarify: We've been through some guesses already. If there's no way to actually tell (e.g. some feature hidden somewhere) then so be it, but I was just hoping that there was a way.

 

No Cloudflare.


freitasm
BDFL - Memuneh
80646 posts

Uber Geek
+1 received by user: 41030

Administrator
ID Verified
Trusted
Geekzone
Lifetime subscriber

  #2943297 18-Jul-2022 09:04
Send private message

Behodar:

 

No Cloudflare.

 

 

For anyone reading this in the future, if you are using Cloudflare: Crawler Hints Update: Cloudflare Supports IndexNow and Announces General Availability

 

This might submit pages even without a link from anywhere else or from a sitemap.





Referral links: Quic Broadband (free setup code: R587125ERQ6VE) | Samsung | AliExpress | Wise | Sharesies 

 

Support Geekzone by subscribing (browse ads-free), or making a one-off or recurring donation through PressPatron.

 


timmmay
20858 posts

Uber Geek
+1 received by user: 5350

Trusted
Lifetime subscriber

  #2943304 18-Jul-2022 09:40
Send private message

Put them into your robots.txt as excluded if you don't want them indexed. People can read the robots.txt and find the pages, but anything sensitive should be properly secured.


 
 
 
 

Shop now for Dell laptops and other devices (affiliate link).
outdoorsnz
694 posts

Ultimate Geek
+1 received by user: 303

ID Verified

  #2943310 18-Jul-2022 09:57
Send private message

Is it possible that your web app / CMS has SEO installed code that alerts google when you publish the page?


Create new topic








Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.



Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.