Squid Proxy - sites used by time....

Welcome Guest.

You haven't logged in yet. If you don't have an account you can register now.

Forums › New Zealand Broadband › Squid Proxy - sites used by time....

davidcole

6034 posts

Uber Geek

Trusted

#72123 21-Nov-2010 11:52

Hi

running a squid proxy at home, mostly for saving bandwidth in windows updates etc.

But now I'd like to see what is using the internet at certain times to track usage.

Anyone know of a linux install/script/report or something that will allow me to see sites used over specified time period?

Previously known as psycik

Home Assistant: Gigabyte AMD A8 Brix, Home Assistant with Aeotech ZWave Controller, Raspberry PI, Wemos D1 Mini, Zwave, Shelly Humidity and Temperature sensors
Media:Chromecast v2, ATV4 4k, ATV4, HDHomeRun Dual
Server Host Plex Server 3x3TB, 4x4TB using MergerFS, Samsung 850 evo 512 GB SSD, Proxmox Server with 1xW10, 2xUbuntu 22.04 LTS, Backblaze Backups, usenetprime.com fastmail.com Sharesies Trakt.TV Sharesight

michaeln

238 posts

Master Geek

Trusted

#407405 21-Nov-2010 20:07

Off http://www.squid-cache.org/Scripts/ is a list of squid log file analysis programs that will tell you what you want to know, .

davidcole

6034 posts

Uber Geek

Trusted

#407414 21-Nov-2010 20:52

I've got calamaris and webalyser on the system but cannot see it producing the information I want.

Have you used one that will do what I want? if so which one?

greaneyr

52 posts

Master Geek

#408246 23-Nov-2010 14:35

I use SARG. It has by far the best summary information of any squid report analysis tool I have tried. It will also draw graphs showing when each machine has visited particular sites, as well as report some of this data numerically.

davidcole

6034 posts

Uber Geek

Trusted

#408302 23-Nov-2010 15:12

Yeah I use sarg as well (configured via webmin - be that good or bad).

And while i can get the usage in bytes etc, I can't figure out what i need to set to say xyz machine visited site abc at so and so time.

greaneyr

52 posts

Master Geek

#408465 23-Nov-2010 18:50

Are you much of a coder in perl or bash or anything that can convert between unix dates and human-readable dates? When I need specific searches such as yours, I usually do my processing against the original squid log. cat /var/log/squid/access.log | filtercommand > anotheraccess.log

Then, run sarg against the filtered output. In your case, you'd just need a filter than reads the start date/time and end date/time, then outputs only lines that fall between the two.

davidcole

6034 posts

Uber Geek

Trusted

#408801 24-Nov-2010 10:57

greaneyr: Are you much of a coder in perl or bash or anything that can convert between unix dates and human-readable dates? When I need specific searches such as yours, I usually do my processing against the original squid log. cat /var/log/squid/access.log | filtercommand > anotheraccess.log

Then, run sarg against the filtered output. In your case, you'd just need a filter than reads the start date/time and end date/time, then outputs only lines that fall between the two.

Not really. I was hoping sarg or webalyser would do it for me.

I've not even really looked at the raw access.log before.

greaneyr

52 posts

Master Geek

#409145 24-Nov-2010 20:39

Well do you want it for an ongoing thing, or are you just wanting to know where people are going between certain times just for a little while? If you were after an ongoing thing, then you probably do need something a little less manual, but if you just wanted it for say a week, then it wouldn't be much at all to make something like I was talking about. I could probably throw something together for you if you thought it might help.

Samsung

Shop now on Samsung phones, tablets, TVs and more (affiliate link).

davidcole

6034 posts

Uber Geek

Trusted

#409176 24-Nov-2010 21:28

if you could, as a manual thing, then I can always hack around with it to make it into a script.

thanks.

News and reviews »

Air New Zealand Starts AI adoption with OpenAI
Posted 24-Jul-2025 16:00

eero Pro 7 Review
Posted 23-Jul-2025 12:07

BeeStation Plus Review
Posted 21-Jul-2025 14:21

eero Unveils New Wi-Fi 7 Products in New Zealand
Posted 21-Jul-2025 00:01

WiZ Introduces HDMI Sync Box and other Light Devices
Posted 20-Jul-2025 17:32

RedShield Enhances DDoS and Bot Attack Protection
Posted 20-Jul-2025 17:26

Seagate Ships 30TB Drives
Posted 17-Jul-2025 11:24

Oclean AirPump A10 Water Flosser Review
Posted 13-Jul-2025 11:05

Samsung Galaxy Z Fold7: Raising the Bar for Smartphones
Posted 10-Jul-2025 02:01

Samsung Galaxy Z Flip7 Brings New Edge-To-Edge FlexWindow
Posted 10-Jul-2025 02:01

Epson Launches New AM-C550Z WorkForce Enterprise printer
Posted 9-Jul-2025 18:22

Samsung Releases Smart Monitor M9
Posted 9-Jul-2025 17:46

Nearly Half of Older Kiwis Still Write their Passwords on Paper
Posted 9-Jul-2025 08:42

D-Link 4G+ Cat6 Wi-Fi 6 DWR-933M Mobile Hotspot Review
Posted 1-Jul-2025 11:34

Oppo A5 Series Launches With New Levels of Durability
Posted 30-Jun-2025 10:15

Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.

Updates »

Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.

RSS feeds: Main feed; Forums feed

Site features: Geekzone BI dashboard; Geekzone Badges; Geekzone Status Page

Affiliate links: Samsung; AliExpress; Wise; Sharesies; GoodSync

Site Information: Subscribe to Geekzone; Privacy Statement; Forum Usage Guidelines (FUG); Advertising; Trademark and copyright