Geekzone: technology news, blogs, forums
Guest
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.


neb



2429 posts

Uber Geek

Trusted
Lifetime subscriber

#269725 4-Apr-2020 18:31
Send private message

I've just set up a power monitor to log voltage, frequency, power factor, etc over modbus, and I'd like to upload and graph it somewhere long-term. There are a bunch of online graphing sites, but they're mostly just Excel for the web. Some time ago I saw a site that allows posting of data via HTTP for long-term storage and viewing but I can't remember what it was, can anyone recommend anything? Data volume is low, three values every few minutes, so any kind of free account should do it, I'd just like to view trends over time and compare what it was like last month vs. this month. Eventually I'll also hook up IFTTT to alarm on the voltage going out of range, which was the motivation for doing this in the first place, but that's for another day.

Filter this topic showing only the reply marked as answer Create new topic
23404 posts

Uber Geek

Trusted
Subscriber

  #2454571 4-Apr-2020 18:33
Send private message

adafruit.io has some good charting options, and can use mqtt which is more use for this sort of thing than http is.





Richard rich.ms

neb



2429 posts

Uber Geek

Trusted
Lifetime subscriber

  #2454574 4-Apr-2020 18:36
Send private message

Ah, it was probably that. HTTP is easier (lazier) than MQTT, I can just script a POST from the modbus data without having to go through another protocol layer.

 
 
 
 


23404 posts

Uber Geek

Trusted
Subscriber

  #2454579 4-Apr-2020 18:40
Send private message

It might support it, I have just used example sketches of theirs in arduino and changed it a little when I was doing things with it. Not played with it in a few years after I found that the probelms with my weather station were all just because 433MHz is a trashfire of a band for anything to operate on.





Richard rich.ms

4893 posts

Uber Geek

Trusted

  #2454620 4-Apr-2020 19:55
Send private message

Influx does have a cloud database if you don’t want to host one yourself.




Previously known as psycik

OpenHAB: Gigabyte AMD A8 BrixOpenHAB with Aeotech ZWave Controller, Raspberry PI, Wemos D1 Mini, Zwave, Xiaomi Humidity and Temperature sensors and Bluetooth LE Sensors
Media:Chromecast v2, ATV4, Roku3, HDHomeRun Dual
Windows 10
Host (Plex Server/Crashplan): 2x2TB, 2x3TB, 1x4TB using DriveBender, Samsung 850 evo 512 GB SSD, Hyper-V Server with 1xW10, 1xW2k8, 2xUbuntu 16.04 LTS, Crashplan, NextPVR channel for Plex,NextPVR Metadata Agent and Scanner for Plex


874 posts

Ultimate Geek


  #2454626 4-Apr-2020 20:06
Send private message

davidcole: Influx does have a cloud database if you don’t want to host one yourself.

 

As does Grafana now too.  I've not used either cloud products. I do use them both at home and log locally.

 

I have used Datadog in the past with a free account. Don't know if they still offer that though.  I was logging data from a BME280 sensor to it from a Raspberry Pi.


3775 posts

Uber Geek

Lifetime subscriber

  #2454685 4-Apr-2020 22:54
Send private message

Sounds like the sort of thing to do via AWS or some other cloud provider, but I'm more familiar with AWS. AWS has a fairly generous free tier, allowing you to put your data into a MySQL database up to 20GB for free. Then you could have static parts of your website (again free) stored in an S3 bucket, and a Lambda function to do the database work.

1463 posts

Uber Geek


  #2454688 4-Apr-2020 23:04
Send private message

You could just use an Azure IoT event hub to pick up the events and push the data into PowerBI via stream analytics.





Software Engineer
   (the practice of real science, engineering and management)


 
 
 
 


'That VDSL Cat'
12366 posts

Uber Geek

Trusted
Spark
Subscriber

  #2454698 5-Apr-2020 00:48
Send private message

frankv: Sounds like the sort of thing to do via AWS or some other cloud provider, but I'm more familiar with AWS. AWS has a fairly generous free tier, allowing you to put your data into a MySQL database up to 20GB for free. Then you could have static parts of your website (again free) stored in an S3 bucket, and a Lambda function to do the database work.
until your 12 month period ends ;)





#include <std_disclaimer>

 

Any comments made are personal opinion and do not reflect directly on the position my current or past employers may have.

 


4893 posts

Uber Geek

Trusted

  #2454737 5-Apr-2020 08:07
Send private message

If you've just got one sensor, you could try thingspeak.

 

That was the first thing I ever published to before getting into openhab/influxdb froma esp8266





Previously known as psycik

OpenHAB: Gigabyte AMD A8 BrixOpenHAB with Aeotech ZWave Controller, Raspberry PI, Wemos D1 Mini, Zwave, Xiaomi Humidity and Temperature sensors and Bluetooth LE Sensors
Media:Chromecast v2, ATV4, Roku3, HDHomeRun Dual
Windows 10
Host (Plex Server/Crashplan): 2x2TB, 2x3TB, 1x4TB using DriveBender, Samsung 850 evo 512 GB SSD, Hyper-V Server with 1xW10, 1xW2k8, 2xUbuntu 16.04 LTS, Crashplan, NextPVR channel for Plex,NextPVR Metadata Agent and Scanner for Plex


3775 posts

Uber Geek

Lifetime subscriber

  #2454765 5-Apr-2020 09:05
Send private message

hio77:

frankv: Sounds like the sort of thing to do via AWS or some other cloud provider, but I'm more familiar with AWS. AWS has a fairly generous free tier, allowing you to put your data into a MySQL database up to 20GB for free. Then you could have static parts of your website (again free) stored in an S3 bucket, and a Lambda function to do the database work.
until your 12 month period ends ;)


No, AWs free tier is forever. I think it's Azure that has the 12 month limit?

And the post above about Azure reminded me that AWS has the same kind of software stack... you can use MQTT to connect to AWS IoT endpoints to analytics.

1463 posts

Uber Geek


  #2455148 5-Apr-2020 15:05
Send private message

frankv: quote hio77:

 

frankv: Sounds like the sort of thing to do via AWS or some other cloud provider, but I'm more familiar with AWS. AWS has a fairly generous free tier, allowing you to put your data into a MySQL database up to 20GB for free. Then you could have static parts of your website (again free) stored in an S3 bucket, and a Lambda function to do the database work.
until your 12 month period ends ;)

 

/quote
No, AWs free tier is forever. I think it's Azure that has the 12 month limit?

And the post above about Azure reminded me that AWS has the same kind of software stack... you can use MQTT to connect to AWS IoT endpoints to analytics.

 

As I understand things AWS has an always free tier, and a 12 month free for some products that sit on top.  I thing the AWS IoT Core has a free tier option, although I have never used it.  Perhaps there is someone that could give some good guidance on it.

 

 

 

 

 

With Azure you can sign up for free and get 200 hours. You can then switch to pay as you go - however, pretty much all of the services have a free version of some kind and for those that don’t the basic charges are minimal.

 

The Azure IoT hub standard tier is free for up to 8000 messages per day (a message is 512 bytes in free tier, 4kb otherwise).

 

One can use VS Code to connect to the IoT hub (runs on linux and windows). One can receive messages from devices and send messages to them.

 

Stream analytics is a realtime processing engine, its job is to do something with the message. It can take input from event hubs, allow one to manipulate it and produce an output say to machine learning, azure functions and database or PowerBI for display (or all of them at once)

 

it is worth while having a read through some of the many tutorials online.   

 

 





Software Engineer
   (the practice of real science, engineering and management)


874 posts

Ultimate Geek


  #2455153 5-Apr-2020 15:11
Send private message

Re AWS Free tier...

 

TLDR: Some is 12months, some is perpetual (on limits - eg Lambda functions).

 

Full details: https://aws.amazon.com/free/?all-free-tier.sort-by=item.additionalFields.SortRank&all-free-tier.sort-order=asc


'That VDSL Cat'
12366 posts

Uber Geek

Trusted
Spark
Subscriber

  #2455162 5-Apr-2020 15:25
Send private message

nzkc:

 

Re AWS Free tier...

 

TLDR: Some is 12months, some is perpetual (on limits - eg Lambda functions).

 

Full details: https://aws.amazon.com/free/?all-free-tier.sort-by=item.additionalFields.SortRank&all-free-tier.sort-order=asc

 

 

Yep. such a confusing stack...

 

 

Personally i use a MariaDB instance configured with Replication on sitting at a few locations.

 

Not that it's critical or anything but dockers are easy to accidentally delete and data is always nice to look back over...

 

 

 

Far more efficient than my ELK stack i used for everything else. 





#include <std_disclaimer>

 

Any comments made are personal opinion and do not reflect directly on the position my current or past employers may have.

 


neb



2429 posts

Uber Geek

Trusted
Lifetime subscriber

  #2455169 5-Apr-2020 15:37
Send private message

davidcole:

If you've just got one sensor, you could try thingspeak.

 

That was the first thing I ever published to before getting into openhab/influxdb froma esp8266

 

 

Ah, it was Thingspeak that I'd seen before but couldn't remember the name of. Currently playing with Adafruit, but I'll give that a go as well, thanks!

 

 

As a general response to the DIY suggestions, I was just looking for a minimal-effort solution, and in particular one with good existing tool support, which both Adafruit and Thingspeak have. Thingspeak at least also has Android/iOS monitoring apps so I can check it via my phone.

neb



2429 posts

Uber Geek

Trusted
Lifetime subscriber

  #2455360 5-Apr-2020 20:38
Send private message

Well, that was really easy, it's up now. The first data points are a bit wonky, I was just testing it out manually, now it's a high-tech "while sleep 59 ; do wget ... done" which is good enough. Be interesting to see what it turns into long-term. Now to see if they have an existing tool to email an alert if it drops to 190V like it did for the neighbours... there's a ThingTweet app but no ThingEmail app that I can find.

Filter this topic showing only the reply marked as answer Create new topic





Twitter and LinkedIn »



Follow us to receive Twitter updates when new discussions are posted in our forums:



Follow us to receive Twitter updates when news items and blogs are posted in our frontpage:



Follow us to receive Twitter updates when tech item prices are listed in our price comparison site:





News »

Soul Machines joins forces with the World Health Organization
Posted 13-Jul-2020 18:00


Chorus completes the build and commissioning of two new core Ethernet switches
Posted 8-Jul-2020 09:48


National Institute for Health Innovation develops treatment app for gambling
Posted 6-Jul-2020 16:25


Nokia 2.3 to be available in New Zealand
Posted 6-Jul-2020 12:30


Menulog change colours as parent company merges with Dutch food delivery service
Posted 2-Jul-2020 07:53


Techweek2020 goes digital to make it easier for Kiwis to connect and learn
Posted 2-Jul-2020 07:48


Catalyst Cloud launches new Solutions Hub to support their kiwi Partners and Customers
Posted 2-Jul-2020 07:44


Microsoft to help New Zealand job seekers acquire new digital skills needed for the COVID-19 economy
Posted 2-Jul-2020 07:41


Hewlett Packard Enterprise introduces new HPE GreenLake cloud services
Posted 24-Jun-2020 08:07


New cloud data protection services from Hewlett Packard Enterprise
Posted 24-Jun-2020 07:58


Hewlett Packard Enterprise unveils HPE Ezmeral, new software portfolio and brand
Posted 24-Jun-2020 07:10


Apple reveals new developer technologies to foster the next generation of apps
Posted 23-Jun-2020 15:30


Poly introduces solutions for Microsoft Teams Rooms
Posted 23-Jun-2020 15:14


Lenovo launches new ThinkPad P Series mobile workstations
Posted 23-Jun-2020 09:17


Lenovo brings Linux certification to ThinkPad and ThinkStation Workstation portfolio
Posted 23-Jun-2020 08:56



Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.


Support Geekzone »

Our community of supporters help make Geekzone possible. Click the button below to join them.

Support Geezone on PressPatron



Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.

Alternatively, you can receive a daily email with Geekzone updates.