Geekzone: technology news, blogs, forums
Guest
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.


Behodar

9249 posts

Uber Geek

Trusted
Lifetime subscriber

#298804 18-Jul-2022 08:22
Send private message

Morning,

 

We have a couple of test pages on our site which aren't shown in the navigation and don't appear in the site map. They're not linked from anywhere and you need to know the direct URLs to get to them.

 

Despite that, they've somehow ended up in the Google search index. Does anyone know whether there's a way to find out how Google got its mitts on the pages? If they're not linked from anywhere then how in the world does Google know they exist?


Create new topic
RunningMan
7966 posts

Uber Geek


  #2943285 18-Jul-2022 08:39
Send private message

Harvested from a link sent to/from a gmail address?


 
 
 
 

Get easy to use, easy to install Norton antivirus protection against advanced online threats (affiliate link).
michaelmurfy
cat
12244 posts

Uber Geek

Moderator
ID Verified
Trusted
Lifetime subscriber

  #2943288 18-Jul-2022 08:48
Send private message

Does anyone who accessed these pages use Google Chrome?




Michael Murphy | https://murfy.nz
Referral Links: Tessie | Tesla | Quic Broadband (use R122101E7CV7Q for free setup)

Are you happy with what you get from Geekzone? Please consider supporting us by subscribing.
Opinions are my own and not the views of my employer.


freitasm
BDFL - Memuneh
76386 posts

Uber Geek

Administrator
ID Verified
Trusted
Geekzone
Lifetime subscriber

  #2943292 18-Jul-2022 08:54
Send private message

Are you using Cloudflare? 





Please support Geekzone by subscribing, or using one of our referral links: Dosh referral: 00001283 | Sharesies | Goodsync | Mighty Ape | Backblaze

 

freitasm on Keybase | My technology disclosure

 

 

 

 

 

 




Behodar

9249 posts

Uber Geek

Trusted
Lifetime subscriber

  #2943294 18-Jul-2022 08:58
Send private message

Just to clarify: We've been through some guesses already. If there's no way to actually tell (e.g. some feature hidden somewhere) then so be it, but I was just hoping that there was a way.

 

No Cloudflare.


freitasm
BDFL - Memuneh
76386 posts

Uber Geek

Administrator
ID Verified
Trusted
Geekzone
Lifetime subscriber

  #2943297 18-Jul-2022 09:04
Send private message

Behodar:

 

No Cloudflare.

 

 

For anyone reading this in the future, if you are using Cloudflare: Crawler Hints Update: Cloudflare Supports IndexNow and Announces General Availability

 

This might submit pages even without a link from anywhere else or from a sitemap.





Please support Geekzone by subscribing, or using one of our referral links: Dosh referral: 00001283 | Sharesies | Goodsync | Mighty Ape | Backblaze

 

freitasm on Keybase | My technology disclosure

 

 

 

 

 

 


timmmay
19632 posts

Uber Geek

Trusted
Lifetime subscriber

  #2943304 18-Jul-2022 09:40
Send private message

Put them into your robots.txt as excluded if you don't want them indexed. People can read the robots.txt and find the pages, but anything sensitive should be properly secured.


outdoorsnz
491 posts

Ultimate Geek


  #2943310 18-Jul-2022 09:57
Send private message

Is it possible that your web app / CMS has SEO installed code that alerts google when you publish the page?


Create new topic





News and reviews »

New Air Traffic Management Platform and Resilient Buildings a Milestone for Airways
Posted 6-Dec-2023 05:00


Logitech G Launches New Flagship Console Wireless Gaming Headset Astro A50 X
Posted 5-Dec-2023 21:00


NordVPN Helps Users Protect Themselves From Vulnerable Apps
Posted 5-Dec-2023 14:27


First-of-its-Kind Flight Trials Integrate Uncrewed Aircraft Into Controlled Airspace
Posted 5-Dec-2023 13:59


Prodigi Technology Services Announces Strategic Acquisition of Conex
Posted 4-Dec-2023 09:33


Samsung Announces Galaxy AI
Posted 28-Nov-2023 14:48


Epson Launches EH-LS650 Ultra Short Throw Smart Streaming Laser Projector
Posted 28-Nov-2023 14:38


Fitbit Charge 6 Review 
Posted 27-Nov-2023 16:21


Cisco Launches New Research Highlighting Gap in Preparedness for AI
Posted 23-Nov-2023 15:50


Seagate Takes Block Storage System to New Heights Reaching 2.5 PB
Posted 23-Nov-2023 15:45


Seagate Nytro 4350 NVMe SSD Delivers Consistent Application Performance and High QoS to Data Centers
Posted 23-Nov-2023 15:38


Amazon Fire TV Stick 4k Max (2nd Generation) Review
Posted 14-Nov-2023 16:17


Over half of New Zealand adults surveyed concerned about AI shopping scams
Posted 3-Nov-2023 10:42


Super Mario Bros. Wonder Launches on Nintendo Switch
Posted 24-Oct-2023 10:56


Google Releases Nest WiFi Pro in New Zealand
Posted 24-Oct-2023 10:18









Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.



Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.







Lenovo