Geekzone: technology news, blogs, forums
Guest
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.




1588 posts

Uber Geek
+1 received by user: 78


Topic # 213950 20-Apr-2017 15:53 Send private message quote this post

I would like to identify online kiwi shopify stores. As far as I can tell there is no directory. I know there are tools to find sub domains on a server etc but I am not sure if they world work.

 

The information I have to go on is 1. Shopify business use bloggs.shopify.com for an address for a business. 2. Most kiwi run business are smart enough to use .co.nz and .nz as address.

 

Is there a clever geeky way to come up with a list?

 

(I have a genuine legal, none spamming reason to identify them.)





Is an English Man living in New Zealand. Not a writer, an Observer he says. Graham is a seasoned 'traveler" with his sometimes arrogant, but honest opinion on life. He loves the Internet!.

GNFB Geeks Out on Geekzone

Email Me

Create new topic
185 posts

Master Geek
+1 received by user: 52


  Reply # 1767974 20-Apr-2017 16:11 Send private message quote this post

One naive attempt: http://lmgtfy.com/?q=powered+by+Shopify+site%3A*.co.nz

 

That's effective as long as you can't remove the 'powered by Shopify' string from the footer, but you can find a common pattern and google it :)




1588 posts

Uber Geek
+1 received by user: 78


  Reply # 1767978 20-Apr-2017 16:15 Send private message quote this post

marpada:

 

One naive attempt: http://lmgtfy.com/?q=powered+by+Shopify+site%3A*.co.nz

 

That's effective as long as you can't remove the 'powered by Shopify' string from the footer, but you can find a common pattern and google it :)

 

 

Man thats a huge start! As we say in the non geek world "Your blood is worth bottling!!" Thanks





Is an English Man living in New Zealand. Not a writer, an Observer he says. Graham is a seasoned 'traveler" with his sometimes arrogant, but honest opinion on life. He loves the Internet!.

GNFB Geeks Out on Geekzone

Email Me

24 posts

Geek
+1 received by user: 11


  Reply # 1768322 21-Apr-2017 10:05 One person supports this post Send private message quote this post

https://www.google.co.nz/search?q=cdn.shopify.co.nz

 

This has benefit of picking up .anything domains using shopify.co.nz

 

They also will all use a common contact form which makes it easy to automate sending them a message

 

POST request to www.domain.com/contact#contact_form

 

PARAMS:

 

"form_type" = "contact"
"contact[name]" = "Mr Smith"
"contact[email]" = "my_email@example.com"
"contact[comments]" = "Hello Spotify customer"

 

A 5 minute Python script to loop over google results and send your message to each site.

 

And here's the script:
https://pastebin.com/daqk2LsE

 

You can change the google search query at the top to whatever you like.

 

Python 2 or 3 (tested on 3)
Requirements: requests

 

It has some simple persistence between runs and shouldn't contact same domain twice.

 

The actual contact form post request is untested.


24 posts

Geek
+1 received by user: 11


  Reply # 1768385 21-Apr-2017 11:12 Send private message quote this post

Actually, a lot of NZ sites use cdn.shopify.com

 

So, maybe a better way is multiple searches like below

cdn.shopify:*.co.nz
cdn.shopify:*.nz




1588 posts

Uber Geek
+1 received by user: 78


  Reply # 1770192 25-Apr-2017 13:57 Send private message quote this post

mattrix:

 

Actually, a lot of NZ sites use cdn.shopify.com

 

So, maybe a better way is multiple searches like below

cdn.shopify:*.co.nz
cdn.shopify:*.nz

 

 

Ok now I have had a chance to look more I see what the CDN is , i assume its Content Delivery network like cloudflare?

 

All Good!

 

Now when i search with this one that you gave me

 

the return is like this

 

https://www.thecountryprovidore.co.nz/ daily https://www ...

 

 

 

https://www.thecountryprovidore.co.nz/sitemap_products_1.xml?from...to...

 

 

 

 

https://www.thecountryprovidore.co.nz/ daily ... 2015-12-16T10:44:01+13:00 daily https://cdn.shopify.com/s/files/1/0918/9052/products/ ...

 

 

 

When I use the other search I get a format like this

 

 

 

 

Mantle Clocks, Designer Clocks & Decorative Homewares – Bob ...

 

 

 

https://www.bobandfriends.co.nz/collections/clocks

 

 

 

 

Mantle Clocks - Bob & Friends: Designer furniture, gifts and home decor. Shop online or in store at our Ponsonby showroom.

 

 

 

The Question what would , and can i use your critera to find the cdn sites but it returns the above format which is easier for importing in to database

 

 

 

Graham

 

 

 

 

 





Is an English Man living in New Zealand. Not a writer, an Observer he says. Graham is a seasoned 'traveler" with his sometimes arrogant, but honest opinion on life. He loves the Internet!.

GNFB Geeks Out on Geekzone

Email Me

Create new topic








Twitter »

Follow us to receive Twitter updates when new discussions are posted in our forums:



Follow us to receive Twitter updates when news items and blogs are posted in our frontpage:



Follow us to receive Twitter updates when tech item prices are listed in our price comparison site:






Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.



Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.

Alternatively, you can receive a daily email with Geekzone updates.