Traffic Shaping / Load Balancing?

Forums › LAN (ethernet/Wifi/routers/Bluetooth) › Traffic Shaping / Load Balancing?

Shrapz

128 posts

Master Geek
+1 received by user: 16

ID Verified

#223683 12-Oct-2017 15:01

At my new house have the option of ADSL2+ (10-12mbit) and Skinny Fixed Wireless (Likely 30-50mbit with external antenna)

If i were to get ADSL2+ and the fixed wireless, is it possible to link these two connections together and then prioritize traffic over a particular connection based on packets?

For example

ADSL2+ Connection

Youtube traffic

Steam Downloads

Game traffic (low ping)

Fixed Wireless

All other web traffic

All other downloads/uploads

This would allow most things to happen without speed being noticed (Except for steam downloads).

What could I put in place to do this?

1 | 2

'That VDSL Cat'
13036 posts

Uber Geek
+1 received by user: 3896

ID Verified

Trusted

Lizard Networks

Subscriber

#1882500 12-Oct-2017 15:36

Yes this is possible.

few platforms out there, each with their pros and cons.

Realistically, you need to have a fair understanding of TCP/IP to correctly identify and tag the packets.

I'd go down the Edgerouter route to terminate connections where possible. Alternative would be a x86 based platform (pfsense, sonicwall etc)

My current setup is a VDSL and ADSL link, with occasional 3G extra support.

i route selected data out certain interfaces (with fallback on congestion/no data where wanted).

All other traffic is balanced between interfaces, netting me close on double bandwidth. (when using multiple TCP sessions spread across the interfaces)

#include <std_disclaimer>

Any comments made are personal opinion and do not reflect directly on the position my current or past employers may have.

vulcannz

436 posts

Ultimate Geek
+1 received by user: 136
Inactive user

#1882531 12-Oct-2017 16:02

hio77:

I'd go down the Edgerouter route to terminate connections where possible. Alternative would be a x86 based platform (pfsense, sonicwall etc)

SonicWall is not x86 based - it uses Cavium Octeon Processors.

hio77

'That VDSL Cat'
13036 posts

Uber Geek
+1 received by user: 3896

ID Verified

Trusted

Lizard Networks

Subscriber

#1882536 12-Oct-2017 16:16

vulcannz:

hio77:

I'd go down the Edgerouter route to terminate connections where possible. Alternative would be a x86 based platform (pfsense, sonicwall etc)

SonicWall is not x86 based - it uses Cavium Octeon Processors.

Sorry was thinking of smoothwall, they both begin with S.....

#include <std_disclaimer>

Any comments made are personal opinion and do not reflect directly on the position my current or past employers may have.

MadEngineer

4591 posts

Uber Geek
+1 received by user: 2570

Trusted

#1882544 12-Oct-2017 16:28

Any router that allows you to set the gateway address based on destination address. This is dead simple on a mikrotik.

You're not on Atlantis anymore, Duncan Idaho.

vulcannz

436 posts

Ultimate Geek
+1 received by user: 136
Inactive user

#1882570 12-Oct-2017 17:51

Shrapz:

At my new house have the option of ADSL2+ (10-12mbit) and Skinny Fixed Wireless (Likely 30-50mbit with external antenna)

If i were to get ADSL2+ and the fixed wireless, is it possible to link these two connections together and then prioritize traffic over a particular connection based on packets?

For example

ADSL2+ Connection

Youtube traffic

Steam Downloads

Game traffic (low ping)

Fixed Wireless

All other web traffic

All other downloads/uploads

This would allow most things to happen without speed being noticed (Except for steam downloads).

What could I put in place to do this?

The problem is you need application based routing, the only box I know does this is the Palo Alto Networks gear. And even then it will be troublesome, you'd also need to decrypt SSL traffic.

hio77

'That VDSL Cat'
13036 posts

Uber Geek
+1 received by user: 3896

ID Verified

Trusted

Lizard Networks

Subscriber

#1882573 12-Oct-2017 18:02

vulcannz:

The problem is you need application based routing, the only box I know does this is the Palo Alto Networks gear. And even then it will be troublesome, you'd also need to decrypt SSL traffic.

The need to do DPI is absoutely the largest limiting factor.

you can rudimentaly do it via ports and IP's (where applicable) however.

#include <std_disclaimer>

Any comments made are personal opinion and do not reflect directly on the position my current or past employers may have.

New World

Shop on-line at New World now for your groceries (affiliate link).

vulcannz

436 posts

Ultimate Geek
+1 received by user: 136
Inactive user

#1882576 12-Oct-2017 18:31

Many applications use port 443 (web/steam/youtube etc). And IPs are irrelevant when CDNs are being used (steam/youtube especially).

MadEngineer

4591 posts

Uber Geek
+1 received by user: 2570

Trusted

#1882581 12-Oct-2017 18:37

On a Mikrotik you can add a domain to an address list, then apply rules to that address list. The router updates the rule with a dynamic entry:

You're not on Atlantis anymore, Duncan Idaho.

hio77

'That VDSL Cat'
13036 posts

Uber Geek
+1 received by user: 3896

ID Verified

Trusted

Lizard Networks

Subscriber

#1882585 12-Oct-2017 18:56

MadEngineer:

On a Mikrotik you can add a domain to an address list, then apply rules to that address list. The router updates the rule with a dynamic entry:

Interesting.

Does it do wildcard for all the video caches unique domains?

#include <std_disclaimer>

Any comments made are personal opinion and do not reflect directly on the position my current or past employers may have.

MadEngineer

4591 posts

Uber Geek
+1 received by user: 2570

Trusted

#1882588 12-Oct-2017 19:09

No, but in the case of www.youtube.com which has a CNAME of youtube-ui.l.google.com which then finally has an A record, a dynamic rule applied to www.youtube.com would apply to all of the above.

If you required wildcard filtering you could run a scheduled foreach in [/ip dns cache find] do={ find "videocache.com" ... script against the DNS cache and add the entries to an address-list, then run a single rule against that address-list

Mikrotik scripting is awesome :)

You're not on Atlantis anymore, Duncan Idaho.

vulcannz

436 posts

Ultimate Geek
+1 received by user: 136
Inactive user

#1882592 12-Oct-2017 19:20

DNS sniffing only goes so far. Plus you will add an overhead in processing...

Here's just 1 single PC doing some youtube today (about an hours worth), not even running SSL decrypt over the traffic:

Geekzone support

Support Geekzone with one-off or recurring donations Donate via PressPatron.

MadEngineer

4591 posts

Uber Geek
+1 received by user: 2570

Trusted

#1882597 12-Oct-2017 19:30

It's hard to tell from your image, but is that all youtube? What are the CNAMEs listed there? Looks like the dynamic address would cover that no problem and there's no overhead for it. As for the script I've used similar before and it certainly didn't have any effect on performance. Definitely nothing wrong using it as a solution to what's wanted here in a domestic situation. For others you'd employ a dedicated appliance(/s)

Edit, actually it's been a while since I had to set up a youtube filter and you couldn't block one 'site' as listed earlier so yes on a Mikrotik a script against .googlevideo.com would be needed.

You could also connection-mark against a layer7 rule that included youtube's addresses with a suitable regexp. The connection-mark process means the router isn't running every packet of data against a rule. (One should always run such a filter on *new* connections only, then mark the connections that apply, then finally mark the packets if needed)

You're not on Atlantis anymore, Duncan Idaho.

MadEngineer

4591 posts

Uber Geek
+1 received by user: 2570

Trusted

#1898291 9-Nov-2017 13:08

*bump*

Filter via layer7 but on dns queries only so your router isn't getting bogged down scanning other traffic:

/ip firewall layer7-protocol
add name=youtube regexp="^.+(youtube).*\$"
add name=videocache regexp="^.+(videocache).*\$"

/ip firewall mangle
add action=mark-connection chain=prerouting protocol=udp dst-port=53 connection-mark=no-mark layer7-protocol=youtube new-connection-mark=youtube_conn passthrough=yes

add action=mark-connection chain=prerouting protocol=udp dst-port=53 connection-mark=no-mark layer7-protocol=videocache new-connection-mark=youtube_conn passthrough=yes

add action=mark-packet chain=prerouting connectionmark=youtube_conn new-packet-mark=youtube_packet

Then you can queue/filter/route those tagged as desired

You're not on Atlantis anymore, Duncan Idaho.