Scraping Electricity usage

Welcome Guest.

You haven't logged in yet. If you don't have an account you can register now.

Forums › Home Workshop DIY › Scraping Electricity usage

1 | 2 | 3

6037 posts

Uber Geek

Trusted

#1805475 23-Jun-2017 07:48

Lol, it works. Spelling mistakes are a wonderful thing...ie someone on their dev team can't spell. Unless it was intentional.

Just need to figure out what parms to give the usage api. In chrome dev tools I can't see the payload I'm sending.

Previously known as psycik

Home Assistant: Gigabyte AMD A8 Brix, Home Assistant with Aeotech ZWave Controller, Raspberry PI, Wemos D1 Mini, Zwave, Shelly Humidity and Temperature sensors
Media:Chromecast v2, ATV4 4k, ATV4, HDHomeRun Dual
Server Host Plex Server 3x3TB, 4x4TB using MergerFS, Samsung 850 evo 512 GB SSD, Proxmox Server with 1xW10, 2xUbuntu 22.04 LTS, Backblaze Backups, usenetprime.com fastmail.com Sharesies Trakt.TV Sharesight

davidcole

6037 posts

Uber Geek

Trusted

#1805506 23-Jun-2017 09:33

Booya:

{u'date': u'2017-06-16T00:00:00+12:00', u'usage': 28.74, u'dollars': 8.2990578, u'estimate': False, u'highligh t': False}

nate

6473 posts

Uber Geek

Retired Mod

Trusted

Lifetime subscriber

#1805513 23-Jun-2017 10:01

davidcole:

Booya:

{u'date': u'2017-06-16T00:00:00+12:00', u'usage': 28.74, u'dollars': 8.2990578, u'estimate': False, u'highligh t': False}

Yay!

davidcole

6037 posts

Uber Geek

Trusted

#1805894 23-Jun-2017 22:00

Quite proud of myself:

This is grafana pulled from an influx db.

Yabanize

2350 posts

Uber Geek

#1805909 23-Jun-2017 22:26

I hear flick actually has an official API beta, hit up their social team if anyone is interested

davidcole

6037 posts

Uber Geek

Trusted

#1806767 26-Jun-2017 09:18

So just been able to pull almost 2 years worth of hourly power data out of genesis. I has some pretty graphs now.

tchart

2380 posts

Uber Geek

ID Verified

Trusted

#1819409 11-Jul-2017 10:10

Is anyone else found Genesis haven't updated their usage data since the 5th? Missing ~5 days of usage data now!

Quic Broadband

Move to New Zealand's best fibre broadband service (affiliate link). Free setup code: R587125ERQ6VE. Note that to use Quic Broadband you must be comfortable with configuring your own router.

davidcole

6037 posts

Uber Geek

Trusted

#1819412 11-Jul-2017 10:13

tchart:

Is anyone else found Genesis haven't updated their usage data since the 5th? Missing ~5 days of usage data now!

Yeah I can see my script has pulled nothing the last time it ran this morning. Still getting a 200 response though, just no data

tchart

2380 posts

Uber Geek

ID Verified

Trusted

#1821961 13-Jul-2017 15:23

Yay, data finally updated!

Hey what trends etc are you guys looking at? These are my charts so far

davidcole

6037 posts

Uber Geek

Trusted

#1821981 13-Jul-2017 15:37

Yeah mine updated as well

tchart

2380 posts

Uber Geek

ID Verified

Trusted

#1854290 28-Aug-2017 19:18

Anyone else having issues scraping the Genesis data? Mine hasnt updated since the 18th :(

davidcole

6037 posts

Uber Geek

Trusted

#1854350 28-Aug-2017 20:29

Mine seems similar again. it comes back, but since I only pull 5 days at a time it leaves a gap.

davidcole

6037 posts

Uber Geek

Trusted

#1857969 4-Sep-2017 10:54

I think it's getting an error, a 406. I'll have to have a look at why. Maybe they've changed something in the authentication.

tchart

2380 posts

Uber Geek

ID Verified

Trusted

#1857990 4-Sep-2017 11:26

davidcole:
I think it's getting an error, a 406. I'll have to have a look at why. Maybe they've changed something in the authentication.

Yeah they updated the website and app recently. So I think this may have caused the issue. I got mine working again so I've got a fix. I'll post the details when I get a chance.

tchart

2380 posts

Uber Geek

ID Verified

Trusted

#1858503 4-Sep-2017 21:40

davidcole:

I think it's getting an error, a 406. I'll have to have a look at why. Maybe they've changed something in the authentication.

So, I had to add these headers to all of my requests ("authorize" included) to get it working again.

req.header("X-OrgCode","GENE")

req.header("X-Source","514C1EDEB42F4A5DBDF484F6BA2A87DC")

You can see the web app sending these. I tried various variations but only these two seemed to work.

AFAIK the X-Source doesnt change between sessions and doesnt seem linked to my account - maybe check your traffic from the web app and let me know if your value is different.

1 | 2 | 3

News and reviews »

Air New Zealand Starts AI adoption with OpenAI
Posted 24-Jul-2025 16:00

eero Pro 7 Review
Posted 23-Jul-2025 12:07

BeeStation Plus Review
Posted 21-Jul-2025 14:21

eero Unveils New Wi-Fi 7 Products in New Zealand
Posted 21-Jul-2025 00:01

WiZ Introduces HDMI Sync Box and other Light Devices
Posted 20-Jul-2025 17:32

RedShield Enhances DDoS and Bot Attack Protection
Posted 20-Jul-2025 17:26

Seagate Ships 30TB Drives
Posted 17-Jul-2025 11:24

Oclean AirPump A10 Water Flosser Review
Posted 13-Jul-2025 11:05

Samsung Galaxy Z Fold7: Raising the Bar for Smartphones
Posted 10-Jul-2025 02:01

Samsung Galaxy Z Flip7 Brings New Edge-To-Edge FlexWindow
Posted 10-Jul-2025 02:01

Epson Launches New AM-C550Z WorkForce Enterprise printer
Posted 9-Jul-2025 18:22

Samsung Releases Smart Monitor M9
Posted 9-Jul-2025 17:46

Nearly Half of Older Kiwis Still Write their Passwords on Paper
Posted 9-Jul-2025 08:42

D-Link 4G+ Cat6 Wi-Fi 6 DWR-933M Mobile Hotspot Review
Posted 1-Jul-2025 11:34

Oppo A5 Series Launches With New Levels of Durability
Posted 30-Jun-2025 10:15

Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.

Updates »

Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.

RSS feeds: Main feed; Forums feed

Site features: Geekzone BI dashboard; Geekzone Badges; Geekzone Status Page

Affiliate links: Samsung; AliExpress; Wise; Sharesies; GoodSync

Site Information: Subscribe to Geekzone; Privacy Statement; Forum Usage Guidelines (FUG); Advertising; Trademark and copyright