Geekzone: technology news, blogs, forums
Guest
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.




3567 posts

Uber Geek
+1 received by user: 387

Trusted

Topic # 72123 21-Nov-2010 11:52
Send private message

Hi

running a squid proxy at home, mostly for saving bandwidth in windows updates etc.

But now I'd like to see what is using the internet at certain times to track usage.

Anyone know of a linux install/script/report or something that will allow me to see sites used over specified time period?




Previously known as psycik

NextPVR/OpenHAB: 
Gigabyte AMD A8 Brix --> Samsung LA46A650D via HDMI, NextPVR,OpenHAB with Aeotech ZWave Controller
Media:Chromecast v2, ATV4, Roku3, Raspberry PI temperature Sensors and Bluetooth LE Sensors,HDHomeRun Dual
Windows 2012 
Host (Plex Server/Crashplan): 2x2TB, 2x3TB, 1x4TB using DriveBender, Samsung 850 evo 512 GB SSD, Hyper-V Server with 1xW10, 1xW2k8, 2xUbuntu 16.04 LTS, Crashplan, NextPVR channel for Plex,NextPVR Metadata Agent and Scanner for Plex


Create new topic
201 posts

Master Geek
+1 received by user: 10

Trusted

  Reply # 407405 21-Nov-2010 20:07
Send private message

Off http://www.squid-cache.org/Scripts/ is a list of squid log file analysis programs that will tell you what you want to know, .
 



3567 posts

Uber Geek
+1 received by user: 387

Trusted

  Reply # 407414 21-Nov-2010 20:52
Send private message

I've got calamaris and webalyser on the system but cannot see it producing the information I want.

Have you used one that will do what I want? if so which one?




Previously known as psycik

NextPVR/OpenHAB: 
Gigabyte AMD A8 Brix --> Samsung LA46A650D via HDMI, NextPVR,OpenHAB with Aeotech ZWave Controller
Media:Chromecast v2, ATV4, Roku3, Raspberry PI temperature Sensors and Bluetooth LE Sensors,HDHomeRun Dual
Windows 2012 
Host (Plex Server/Crashplan): 2x2TB, 2x3TB, 1x4TB using DriveBender, Samsung 850 evo 512 GB SSD, Hyper-V Server with 1xW10, 1xW2k8, 2xUbuntu 16.04 LTS, Crashplan, NextPVR channel for Plex,NextPVR Metadata Agent and Scanner for Plex


 
 
 
 


43 posts

Geek


  Reply # 408246 23-Nov-2010 14:35
Send private message

I use SARG. It has by far the best summary information of any squid report analysis tool I have tried. It will also draw graphs showing when each machine has visited particular sites, as well as report some of this data numerically.



3567 posts

Uber Geek
+1 received by user: 387

Trusted

  Reply # 408302 23-Nov-2010 15:12
Send private message

Yeah I use sarg as well (configured via webmin - be that good or bad).

And while i can get the usage in bytes etc, I can't figure out what i need to set to say xyz machine visited site abc at so and so time.




Previously known as psycik

NextPVR/OpenHAB: 
Gigabyte AMD A8 Brix --> Samsung LA46A650D via HDMI, NextPVR,OpenHAB with Aeotech ZWave Controller
Media:Chromecast v2, ATV4, Roku3, Raspberry PI temperature Sensors and Bluetooth LE Sensors,HDHomeRun Dual
Windows 2012 
Host (Plex Server/Crashplan): 2x2TB, 2x3TB, 1x4TB using DriveBender, Samsung 850 evo 512 GB SSD, Hyper-V Server with 1xW10, 1xW2k8, 2xUbuntu 16.04 LTS, Crashplan, NextPVR channel for Plex,NextPVR Metadata Agent and Scanner for Plex


43 posts

Geek


  Reply # 408465 23-Nov-2010 18:50
Send private message

Are you much of a coder in perl or bash or anything that can convert between unix dates and human-readable dates? When I need specific searches such as yours, I usually do my processing against the original squid log. cat /var/log/squid/access.log | filtercommand > anotheraccess.log

Then, run sarg against the filtered output. In your case, you'd just need a filter than reads the start date/time and end date/time, then outputs only lines that fall between the two.



3567 posts

Uber Geek
+1 received by user: 387

Trusted

  Reply # 408801 24-Nov-2010 10:57
Send private message

greaneyr: Are you much of a coder in perl or bash or anything that can convert between unix dates and human-readable dates? When I need specific searches such as yours, I usually do my processing against the original squid log. cat /var/log/squid/access.log | filtercommand > anotheraccess.log

Then, run sarg against the filtered output. In your case, you'd just need a filter than reads the start date/time and end date/time, then outputs only lines that fall between the two.


Not really. I was hoping sarg or webalyser would do it for me.

I've not even really looked at the raw access.log before.




Previously known as psycik

NextPVR/OpenHAB: 
Gigabyte AMD A8 Brix --> Samsung LA46A650D via HDMI, NextPVR,OpenHAB with Aeotech ZWave Controller
Media:Chromecast v2, ATV4, Roku3, Raspberry PI temperature Sensors and Bluetooth LE Sensors,HDHomeRun Dual
Windows 2012 
Host (Plex Server/Crashplan): 2x2TB, 2x3TB, 1x4TB using DriveBender, Samsung 850 evo 512 GB SSD, Hyper-V Server with 1xW10, 1xW2k8, 2xUbuntu 16.04 LTS, Crashplan, NextPVR channel for Plex,NextPVR Metadata Agent and Scanner for Plex


43 posts

Geek


  Reply # 409145 24-Nov-2010 20:39
Send private message

Well do you want it for an ongoing thing, or are you just wanting to know where people are going between certain times just for a little while? If you were after an ongoing thing, then you probably do need something a little less manual, but if you just wanted it for say a week, then it wouldn't be much at all to make something like I was talking about. I could probably throw something together for you if you thought it might help.



3567 posts

Uber Geek
+1 received by user: 387

Trusted

  Reply # 409176 24-Nov-2010 21:28
Send private message

if you could, as a manual thing, then I can always hack around with it to make it into a script.

thanks.




Previously known as psycik

NextPVR/OpenHAB: 
Gigabyte AMD A8 Brix --> Samsung LA46A650D via HDMI, NextPVR,OpenHAB with Aeotech ZWave Controller
Media:Chromecast v2, ATV4, Roku3, Raspberry PI temperature Sensors and Bluetooth LE Sensors,HDHomeRun Dual
Windows 2012 
Host (Plex Server/Crashplan): 2x2TB, 2x3TB, 1x4TB using DriveBender, Samsung 850 evo 512 GB SSD, Hyper-V Server with 1xW10, 1xW2k8, 2xUbuntu 16.04 LTS, Crashplan, NextPVR channel for Plex,NextPVR Metadata Agent and Scanner for Plex


Create new topic



Twitter »

Follow us to receive Twitter updates when new discussions are posted in our forums:



Follow us to receive Twitter updates when news items and blogs are posted in our frontpage:



Follow us to receive Twitter updates when tech item prices are listed in our price comparison site:





News »

UFB killer app: Speed
Posted 17-Nov-2017 17:01


The case for RSS — MacSparky
Posted 13-Nov-2017 14:35


WordPress and Indieweb: Take control of your online presence — 6:30 GridAKL Nov 30
Posted 11-Nov-2017 13:43


Chorus reveals technology upgrade for schools, students
Posted 10-Nov-2017 10:28


Vodafone says Internet of Things (IoT) crucial for digital transformation
Posted 10-Nov-2017 10:06


Police and Facebook launch AMBER Alerts system in NZ
Posted 9-Nov-2017 10:49


Amazon debuts Fire TV Stick Basic Edition in over 100 new countries
Posted 8-Nov-2017 05:34


Vodafone VoIP transition to start this month
Posted 7-Nov-2017 12:33


Spark enhances IoT network capability
Posted 7-Nov-2017 11:33


Vocus NZ sale and broadband competition
Posted 6-Nov-2017 14:36


Hawaiki reaches key milestone in landmark deep-sea fibre project
Posted 4-Nov-2017 13:53


Countdown launches new proximity online shopping app
Posted 4-Nov-2017 13:50


Nokia 3310 to be available through Spark New Zealand
Posted 4-Nov-2017 13:31


Nest launches in New Zealand
Posted 4-Nov-2017 12:31


Active wholesale as Chorus tackles wireless challenge
Posted 3-Nov-2017 10:55



Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.



Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.

Alternatively, you can receive a daily email with Geekzone updates.