Geekzone: technology news, blogs, forums
Guest
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.




4499 posts

Uber Geek

Trusted

#251162 11-Jun-2019 13:29
Send private message

So my home server runs on average consumer hardware... i5 6400, 32GB RAM, cant remember motherboard model, Asus something, six SATA's onbaord with RAID available.

 

I run Proxmox for the Hypervisor, that won't be changing. The hypervisor and the virtual disks are on a pair of NVMe drives in RAID 1 - ultra-fast no issues with that.

 

I then have 4x WD Red drives that I have had since the beginning of time apparently - clocking up 48000+ hours each. They are in a ZFS 'raid 0' with a 128GB SSD cache drive - built within Proxmox. And then I have a FreeNAS VM where that array is mounted.

 

Problem is read/writes can be just abysmal and with the introduction of a 4K HDR TV, movie play back can suck sometimes unless its the only thing trying to do stuff to that disk array. The biggest issue is the massive variances in speeds I see - I assume when the SSD caches gets full the performance plummets. As reported by Windows, reads hover around 25MB/s but writes can plummet way down to 10-15MB/s.

 

The server has dual gigabit NIC's on a 802.3ad LAG.

 

So the two options I see are:

 

1) SSD's

 

4x Samsung 860 2TB drives - $401ea - $1604 (and use onboard SATA and onboard RAID, to do a RAID 5)

 

+ Hardware RAID card to reconnect the old 2TB drives for stuff that can be slow (photos, documents etc)

 

2) New HDD's & Hardware RAID

 

4x Ironwolf Pro's (they seem quite cheap for 'pro') 2TB - $221ea - $884

 

+ Hardware RAID card and do a RAID 5 set up?

 

 

 

At this point, I intend on ditching FreeNAS and probably go to OpenMediaVault as I don't think I get any benefit from ZFS and I can use a linux container rather than VM to spare up some RAM.

 

The NAS storage is really just for movies and TV, and some photo storage.

 

What would you do?

 

Considerations:
- I don't really want to spend the money on SSD's
- I don't care about redundancy - tv and movies aren't important. I know I'm talking about RAID 5, but the final goal is just better performance - if I achieve that without RAID, so be it.
- Will also probably stick a 10Gig network card in as I have SFP+'s on my switch.


Create new topic
'That VDSL Cat'
12165 posts

Uber Geek

Trusted
Spark
Subscriber

  #2256065 11-Jun-2019 13:56
Send private message

i run an unraid box, Love it.

it does the full 1gbit for reads, it does the parity.

 

Writes hover at the 30-60MB/s mark with solid 1Gbit until ram cache fulls (it's an old Athlon X2, it's CPU limited not disk limited)

 

 

 

I'd really stick to software raid for your usecase.

 

The biggest thing stopping me from nas'ing all my storage, is all the tier storage solutions currently are only Block level for windows.

 

 

 

 

 

I'd love to stick a 2TB SSD or two, infront of a network storage, have it cache what i'm using and move everything off to spinning disks in the network.





#include <std_disclaimer>

 

Any comments made are personal opinion and do not reflect directly on the position my current or past employers may have.

 


6285 posts

Uber Geek

Moderator
Trusted
Lifetime subscriber

  #2256078 11-Jun-2019 14:21
Send private message

+1 Unraid here.  It's bloody awesome.  40TB array with parity, 1TB SSD cache, 500GB SSD for VMs. Docker containers, plugins, VMs, etc.  It's fantastic.  


 
 
 
 




4499 posts

Uber Geek

Trusted

  #2256091 11-Jun-2019 14:35
Send private message

Would unraid's software raid give me a decent performance boost though compared with just a hw raid card and virtual disk?

I'm not too keen to move away from Proxmox for virtualisation. All the VMs (or containers to be accurate) are set up and working perfectly, it's just the spinning rust that I think is my issue.

'That VDSL Cat'
12165 posts

Uber Geek

Trusted
Spark
Subscriber

  #2256094 11-Jun-2019 14:38
Send private message

chevrolux: Would unraid's software raid give me a decent performance boost though compared with just a hw raid card and virtual disk?

I'm not too keen to move away from Proxmox for virtualisation. All the VMs (or containers to be accurate) are set up and working perfectly, it's just the spinning rust that I think is my issue.

 

 

 

No it will give you a drop unless you move to the new fangled RAID options in unraid.

 

 

 

Personally i still use ResizerFS, Every disk is able to be removed and read manually should the worst happen. Perfect for Content Archives.





#include <std_disclaimer>

 

Any comments made are personal opinion and do not reflect directly on the position my current or past employers may have.

 


87 posts

Master Geek


  #2256095 11-Jun-2019 14:39
Send private message

I have successfully run Proxmox in a KVM on Unraid for running my existing LXC's.. It was just another node in my cluster as far as Proxmox was concerned.

 

Daniel


1533 posts

Uber Geek


  #2256098 11-Jun-2019 14:44
Send private message

Possibly you would get better performance by passing the WD harddisks through to the FreeNAS VM, if I read your config right you have your Proxmox host configuring the disks as RAID-0 ZFS (aweful idea by the way), then you are running a FreeNAS VM which in turn will have it's own virtual disks on the hosts ZFS filesystem and it then puts filesystems on top (probably ZFS again ?) .. that would suck for performance.

 

To go you a performance comparison ... I had an old Linux based NAS  with an Atom D525 and 3GiB RAM with some equally elderly 2TB drive in software RAID-5 (MDM) with LVM on top of that and a big EXT4 filesystem.  It can max out 2 * 1Gbit links in LACP trunk for both reads and writes sustained.

 

Personally I wouldn't do hardware RAID, it limits portability (moving the disks and data to another system) and data recovery options and doesn;t really give much more in performance for what you want.

 

 




4499 posts

Uber Geek

Trusted

  #2256193 11-Jun-2019 16:26
Send private message

Ok so good points re expanding hardware raid.

@hio77 you mention saturating 1Gb link. Is that with spinning disks? Consumer 7200s?

And if I move to unraid, how does that parity drive work in terms of sizing? I need around 6-8TB usable storage.

 
 
 
 


'That VDSL Cat'
12165 posts

Uber Geek

Trusted
Spark
Subscriber

  #2256362 11-Jun-2019 21:12
Send private message

chevrolux: Ok so good points re expanding hardware raid.

@hio77 you mention saturating 1Gb link. Is that with spinning disks? Consumer 7200s?

And if I move to unraid, how does that parity drive work in terms of sizing? I need around 6-8TB usable storage.

 

 

 

Yes, i do buy only toshibas though, they are actually quite well priced and insanely fast.

 

 

 

Their only downside is there are loud and do produce a fair bit more heat than a standard disk. - parity needs to be the largest or equal largest disk.

 

 

This is a straight copy from box to one of my SSD's, it's a little sluggish right now as there is content streaming but hitting 100MB/s is pretty nice for me.

 

 

 

For only 8TB, your really more in the market for a standard nas off the shelf tbh. that can be done in 2 Disks...





#include <std_disclaimer>

 

Any comments made are personal opinion and do not reflect directly on the position my current or past employers may have.

 




4499 posts

Uber Geek

Trusted

  #2256379 11-Jun-2019 21:30
Send private message

That's awesome thanks. I've been in half a mind to just buy a NAS and just leave this machine to do all the VM's. But then I kind of like it all being in one box - it's also been good to be able to have virtual NICs to mount the NAS shares on the VM's.

 

Turns out I can get those Ironwolf Pro 2TB's for $147 each, not sure I will beat that and because they're cheap will grab six of them to fill up the SATA ports. Will take a look at the toshiba drives though.


'That VDSL Cat'
12165 posts

Uber Geek

Trusted
Spark
Subscriber

  #2256384 11-Jun-2019 21:35
Send private message

https://www.amazon.com/Toshiba-Performance-Desktop-Internal-HDWE160XZSTA/dp/B013JPLKJC

 

 

 

Newer versions of the ones i run but this is them.

 

I've got TOSHIBA_MD04ACA500.

 

 

 

The newer models i've been meaning to order a few in. Double the Cache which should help.





#include <std_disclaimer>

 

Any comments made are personal opinion and do not reflect directly on the position my current or past employers may have.

 


779 posts

Ultimate Geek


  #2256452 12-Jun-2019 08:34
Send private message

+1 Unraid here. 

 

 


Create new topic



Twitter and LinkedIn »



Follow us to receive Twitter updates when new discussions are posted in our forums:



Follow us to receive Twitter updates when news items and blogs are posted in our frontpage:



Follow us to receive Twitter updates when tech item prices are listed in our price comparison site:





News »

OPPO Find X2 Lite brings flagship features to mid-range 5G smartphone
Posted 29-May-2020 12:52


Sony introduces the digital camera ZV-1 for content creators
Posted 27-May-2020 12:47


Samsung Announces 2020 QLED TV Range
Posted 20-May-2020 16:29


D-Link A/NZ launches AI-Powered body temperature measuring system
Posted 20-May-2020 16:22


NortonLifeLock Online Banking Protection now available for New Zealand banks
Posted 20-May-2020 16:14


SD Express delivers new gigabyte speeds for SD memory cards
Posted 20-May-2020 15:00


D-Link A/NZ launches Nuclias cloud managed network solution hosted in Australia
Posted 11-May-2020 17:53


Logitech introduces new video streaming solution for home studios
Posted 11-May-2020 17:48


Next generation Volvo cars to be powered by Luminar LiDAR technology
Posted 7-May-2020 13:56


D-Link A/NZ launches Wi-Fi Certified EasyMesh system
Posted 7-May-2020 13:51


Spark teams up with Microsoft to bring Xbox All Access to New Zealand
Posted 7-May-2020 13:01


Microsoft plans to establish its first datacenter region in New Zealand
Posted 6-May-2020 11:35


Genesis School-gen has joined forces with Mind Lab Kids
Posted 1-May-2020 12:53


Malwarebytes expands into privacy with fast, frictionless VPN
Posted 30-Apr-2020 16:06


Kordia to donate TV airtime on Channel 200 to community groups
Posted 30-Apr-2020 16:00



Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.


Support Geekzone »

Our community of supporters help make Geekzone possible. Click the button below to join them.

Support Geezone on PressPatron



Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.

Alternatively, you can receive a daily email with Geekzone updates.