Excuse me oh! Clever Ones!

Forums › IT Pro and developers › Excuse me oh! Clever Ones!

gnfb

1674 posts

Uber Geek
+1 received by user: 86

Topic # 213950 20-Apr-2017 15:53

I would like to identify online kiwi shopify stores. As far as I can tell there is no directory. I know there are tools to find sub domains on a server etc but I am not sure if they world work.

The information I have to go on is 1. Shopify business use bloggs.shopify.com for an address for a business. 2. Most kiwi run business are smart enough to use .co.nz and .nz as address.

Is there a clever geeky way to come up with a list?

(I have a genuine legal, none spamming reason to identify them.)

Is an English Man living in New Zealand. Not a writer, an Observer he says. Graham is a seasoned 'traveler" with his sometimes arrogant, but honest opinion on life. He loves the Internet!.

gnfb on trademe travelkit.nz

GNFB Geeks Out on Geekzone

Email Me

marpada

216 posts

Master Geek
+1 received by user: 62

Reply # 1767974 20-Apr-2017 16:11

One naive attempt: http://lmgtfy.com/?q=powered+by+Shopify+site%3A*.co.nz

That's effective as long as you can't remove the 'powered by Shopify' string from the footer, but you can find a common pattern and google it :)

gnfb

1674 posts

Uber Geek
+1 received by user: 86

Reply # 1767978 20-Apr-2017 16:15

marpada:

One naive attempt: http://lmgtfy.com/?q=powered+by+Shopify+site%3A*.co.nz

That's effective as long as you can't remove the 'powered by Shopify' string from the footer, but you can find a common pattern and google it :)

Man thats a huge start! As we say in the non geek world "Your blood is worth bottling!!" Thanks

Is an English Man living in New Zealand. Not a writer, an Observer he says. Graham is a seasoned 'traveler" with his sometimes arrogant, but honest opinion on life. He loves the Internet!.

gnfb on trademe travelkit.nz

GNFB Geeks Out on Geekzone

Email Me

mattrix

194 posts

Master Geek
+1 received by user: 55
Inactive user

Reply # 1768322 21-Apr-2017 10:05

https://www.google.co.nz/search?q=cdn.shopify.co.nz

This has benefit of picking up .anything domains using shopify.co.nz

They also will all use a common contact form which makes it easy to automate sending them a message

POST request to www.domain.com/contact#contact_form

PARAMS:

"form_type" = "contact"
"contact[name]" = "Mr Smith"
"contact[email]" = "my_email@example.com"
"contact[comments]" = "Hello Spotify customer"

A 5 minute Python script to loop over google results and send your message to each site.

And here's the script:
https://pastebin.com/daqk2LsE

You can change the google search query at the top to whatever you like.

Python 2 or 3 (tested on 3)
Requirements: requests

It has some simple persistence between runs and shouldn't contact same domain twice.

The actual contact form post request is untested.

mattrix

194 posts

Master Geek
+1 received by user: 55
Inactive user

Reply # 1768385 21-Apr-2017 11:12

Actually, a lot of NZ sites use cdn.shopify.com

So, maybe a better way is multiple searches like below

cdn.shopify:*.co.nz
cdn.shopify:*.nz

gnfb

1674 posts

Uber Geek
+1 received by user: 86

Reply # 1770192 25-Apr-2017 13:57

mattrix:

Actually, a lot of NZ sites use cdn.shopify.com

So, maybe a better way is multiple searches like below

cdn.shopify:*.co.nz
cdn.shopify:*.nz

Ok now I have had a chance to look more I see what the CDN is , i assume its Content Delivery network like cloudflare?

All Good!

Now when i search with this one that you gave me

the return is like this

https://www.thecountryprovidore.co.nz/ daily https://www ...

https://www.thecountryprovidore.co.nz/sitemap_products_1.xml?from...to...

https://www.thecountryprovidore.co.nz/ daily ... 2015-12-16T10:44:01+13:00 daily https://cdn.shopify.com/s/files/1/0918/9052/products/ ...

When I use the other search I get a format like this

Mantle Clocks, Designer Clocks & Decorative Homewares – Bob ...

https://www.bobandfriends.co.nz/collections/clocks

Mantle Clocks - Bob & Friends: Designer furniture, gifts and home decor. Shop online or in store at our Ponsonby showroom.

The Question what would , and can i use your critera to find the cdn sites but it returns the above format which is easier for importing in to database

Graham

Is an English Man living in New Zealand. Not a writer, an Observer he says. Graham is a seasoned 'traveler" with his sometimes arrogant, but honest opinion on life. He loves the Internet!.

gnfb on trademe travelkit.nz

GNFB Geeks Out on Geekzone

Email Me