Geekzone: technology news, blogs, forums
Guest
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.


View this topic in a long page with up to 500 replies per page Create new topic
1 | 2 | 3 | 4
2593 posts

Uber Geek

Trusted
Subscriber

  # 2260984 19-Jun-2019 17:30
Send private message

CokemonZ: The machine is multi-purpose and I have no Linux experience.
It is a
Plex server
Also use camera sync to this
Sonarr machine
Radarr machine
File server for home pcs
Qbittorrent workhorse
Backblaze backups


I am just terrified of the amount of work that will need to go into setting it up on another os that I have no experience with.

I couldn't even get ipv6 working in my edge router - showing you my level of comfort with alternative systems.

 

Your usecase is ideal for Unraid. You can run most of what you are doing in dockers. I was an Unraid and linux noob at the beginning of this year and went with it based on the advice here. It's excellent and there are excellent tutorials on youtube here. You almost never need to touch command line, you can do almost everything through a GUI.

 

I have zero regrets of going that way and it's much easier to maintain than the windows systems I had before.




342 posts

Ultimate Geek


  # 2261090 19-Jun-2019 20:21
Send private message

richms:

 

There is a setting to say that its battery backed which when enabled will make it a crapload faster but you're at the risk of powerdowns losing your data. I turned it on for my space that I store media on since its not really a big issue when I am copying stuff onto it if it gets messed up if powered off part way thru since I can just restart it again.

 

 

 

 

 

 

Ok - now we're onto something!

 

So I am getting about 35 - 40mb write speed. I followed this: http://www.tecfused.com/2014/11/storage-spaces-and-parity-slow-write-speeds/

 

However, I am getting strange points where it stops for 3 -4 seconds and no writes at all. Do you get the same?

 

Large (10gb or so files) stopping in the file transfer, not at the end.

 

 

 

 


 
 
 
 




342 posts

Ultimate Geek


  # 2261136 19-Jun-2019 21:25
Send private message

And it looks like the ntfs log file.
The response time for it goes through the roof, then everything dies.

Mr Snotty
8915 posts

Uber Geek

Moderator
Trusted
Lifetime subscriber

  # 2261162 19-Jun-2019 22:32
Send private message

Handle9:

 

Your usecase is ideal for Unraid. You can run most of what you are doing in dockers. I was an Unraid and linux noob at the beginning of this year and went with it based on the advice here. It's excellent and there are excellent tutorials on youtube here. You almost never need to touch command line, you can do almost everything through a GUI.

 

I have zero regrets of going that way and it's much easier to maintain than the windows systems I had before.

 

Fully agree - I may be a *nix systems administrator by trade but I can count on my hand the amount of times I've had to go into the command line for anything on my UnRaid server - not that I needed to, but because (for me) it was quicker than using the GUI.

 

Docker containers are awesome and the whole system is simple to use - it has an app store, a very active community and to be perfectly honest I'd say it is easier than Windows with setting up anything. It does boot off a flash drive so if you want to try it then just try it.

 

Linux is honestly far easier than most people think to use and for you it does sound better suited for your needs - using something like UnRaid is actually easier than Windows due to the well thought out web interface. It may be Linux behind the scenes but don't let this scare you off. I can think of 5 people on here who are self-confessed Linux n00bs but have learnt by either means of a Raspberry Pi or even installed UnRaid and had a good play around.

 

Don't be scared using an alternative operating system - UnRaid is designed to be quite easy and trust me, it beats messing around with Windows storage spaces.







342 posts

Ultimate Geek


  # 2261244 20-Jun-2019 09:32
Send private message

michaelmurfy:

 

Handle9:

 

Your usecase is ideal for Unraid. You can run most of what you are doing in dockers. I was an Unraid and linux noob at the beginning of this year and went with it based on the advice here. It's excellent and there are excellent tutorials on youtube here. You almost never need to touch command line, you can do almost everything through a GUI.

 

I have zero regrets of going that way and it's much easier to maintain than the windows systems I had before.

 

Fully agree - I may be a *nix systems administrator by trade but I can count on my hand the amount of times I've had to go into the command line for anything on my UnRaid server - not that I needed to, but because (for me) it was quicker than using the GUI.

 

Docker containers are awesome and the whole system is simple to use - it has an app store, a very active community and to be perfectly honest I'd say it is easier than Windows with setting up anything. It does boot off a flash drive so if you want to try it then just try it.

 

Linux is honestly far easier than most people think to use and for you it does sound better suited for your needs - using something like UnRaid is actually easier than Windows due to the well thought out web interface. It may be Linux behind the scenes but don't let this scare you off. I can think of 5 people on here who are self-confessed Linux n00bs but have learnt by either means of a Raspberry Pi or even installed UnRaid and had a good play around.

 

Don't be scared using an alternative operating system - UnRaid is designed to be quite easy and trust me, it beats messing around with Windows storage spaces.

 

 

 

 

Allright - so I've had a look and tend to agree with what you say, unraid looks easy enough - if Linus Tech Tips can pull it off, I am sure I can :)

 

 

 

A couple of things are appealing - it boots off USB, so while experimenting I can keep my windows install intact.

 

I like the idea of using a SSD as a cache. The drives I have are 2.5" and 5400 rpm so slow......so this should help. Limited to the amount of Drives I can have, so won't have mirrored caches.

 

 

 

So what would my migration strategy be is the question. All of my drives are NTFS formatted.

 

I have cleared off 3 that can be the initial array, but how would I transfer all my data from NTFS drives to unraid drives, without it flaking - linux NTFS drivers are notoriously horrible?

 

 

 

I also share my plex server. as this is essentially building a new one, would I need to manually add everyone back? I have plexpass if that would make things easier.


Mr Snotty
8915 posts

Uber Geek

Moderator
Trusted
Lifetime subscriber

  # 2261300 20-Jun-2019 10:00
Send private message

With Plex it is rather easy to migrate this - see: https://support.plex.tv/articles/201370363-move-an-install-to-another-system/

 

One of the biggest problems is you'll need to re-format your drives. As you mentioned, you do have a 10tb external you can offload to. I'd recommend re-creating your array and importing your data back. Using a SSD cache helps heaps (I have NZBGet download to the SSD cache which gets offloaded to my array every couple of hours). Anything write-intensive you can set to use your SSD cache and have it offload later to your array to speed things up.

 

But otherwise the beauty of doing this is any drive you have will work in the array. You need to ensure the biggest (and fastest of the biggest - would recommend a 3.5" 7200rpm spinner) drive is the Parity (or use 2x parity drives if you want to be extra safe) but otherwise you can mix and match drives a little like Storage Spaces. For example, I have 2x 8tb and 2x 3tb drives - one of the 8tb drives is parity and the rest are storage giving me 14tb of usable space. I also have a 1tb NVME cache drive.

 

But you won't regret it - yes, it is Linux but like we say there are a tonne of tutorials out there - check out this channel also for some tips on Plex and UnRaid:

 

 

 





4567 posts

Uber Geek

Trusted

  # 2261302 20-Jun-2019 10:04
Send private message

Following along because it's interesting, and was something I'd considered quite a bit also.  How easy is it to get unraid to run a windows virtual machine?  I don't actually own a computer I can sit at, I RDP from a work laptop that I have to take home.  THe linux stuff I'm happy with, I run enough with VMs and odroids and raspberry pis, but I still have the odd need for windows machines (hd home run drivers, my main "developer" machine etc)

 

Do you run vmware on unraid?  And I assume with unraid you can run a suite of docker-compose.yml files for your various services?  I'd hate to have to redo it all in some proprietary gui.





Previously known as psycik

OpenHAB: Gigabyte AMD A8 BrixOpenHAB with Aeotech ZWave Controller, Raspberry PI, Wemos D1 Mini, Zwave, Xiaomi Humidity and Temperature sensors and Bluetooth LE Sensors
Media:Chromecast v2, ATV4, Roku3, HDHomeRun Dual
Windows 10
Host (Plex Server/Crashplan): 2x2TB, 2x3TB, 1x4TB using DriveBender, Samsung 850 evo 512 GB SSD, Hyper-V Server with 1xW10, 1xW2k8, 2xUbuntu 16.04 LTS, Crashplan, NextPVR channel for Plex,NextPVR Metadata Agent and Scanner for Plex


 
 
 
 




342 posts

Ultimate Geek


  # 2261310 20-Jun-2019 10:23
Send private message

michaelmurfy:

 

With Plex it is rather easy to migrate this - see: https://support.plex.tv/articles/201370363-move-an-install-to-another-system/

 

One of the biggest problems is you'll need to re-format your drives. As you mentioned, you do have a 10tb external you can offload to. I'd recommend re-creating your array and importing your data back. Using a SSD cache helps heaps (I have NZBGet download to the SSD cache which gets offloaded to my array every couple of hours). Anything write-intensive you can set to use your SSD cache and have it offload later to your array to speed things up.

 

But otherwise the beauty of doing this is any drive you have will work in the array. You need to ensure the biggest (and fastest of the biggest - would recommend a 3.5" 7200rpm spinner) drive is the Parity (or use 2x parity drives if you want to be extra safe) but otherwise you can mix and match drives a little like Storage Spaces. For example, I have 2x 8tb and 2x 3tb drives - one of the 8tb drives is parity and the rest are storage giving me 14tb of usable space. I also have a 1tb NVME cache drive.

 

But you won't regret it - yes, it is Linux but like we say there are a tonne of tutorials out there - check out this channel also for some tips on Plex and UnRaid:

 

 

 

 

I don't have enough extra storage to move everything off in one go.

 

So could Unraid mount my NTFS drives so I can copy stuff off, then grow the array, copy more, rinse and repeat :)

 

 


4567 posts

Uber Geek

Trusted

  # 2261328 20-Jun-2019 10:29
Send private message

CokemonZ:

 

michaelmurfy:

 

With Plex it is rather easy to migrate this - see: https://support.plex.tv/articles/201370363-move-an-install-to-another-system/

 

One of the biggest problems is you'll need to re-format your drives. As you mentioned, you do have a 10tb external you can offload to. I'd recommend re-creating your array and importing your data back. Using a SSD cache helps heaps (I have NZBGet download to the SSD cache which gets offloaded to my array every couple of hours). Anything write-intensive you can set to use your SSD cache and have it offload later to your array to speed things up.

 

But otherwise the beauty of doing this is any drive you have will work in the array. You need to ensure the biggest (and fastest of the biggest - would recommend a 3.5" 7200rpm spinner) drive is the Parity (or use 2x parity drives if you want to be extra safe) but otherwise you can mix and match drives a little like Storage Spaces. For example, I have 2x 8tb and 2x 3tb drives - one of the 8tb drives is parity and the rest are storage giving me 14tb of usable space. I also have a 1tb NVME cache drive.

 

But you won't regret it - yes, it is Linux but like we say there are a tonne of tutorials out there - check out this channel also for some tips on Plex and UnRaid:

 

 

 

 

I don't have enough extra storage to move everything off in one go.

 

So could Unraid mount my NTFS drives so I can copy stuff off, then grow the array, copy more, rinse and repeat :)

 

 

 

 

 

 

What format are the linux drives once they're in unraid?  One of the big selling points (to me and others) with Storage spaces, drivebender, drive pool, is that the drives remain standard NTFS volumes.  So if the hardware dies, you can just take a drive out and put it in any other windows machines.

 

If that was a consideration for while you were on windows, that might need to be confirmed.





Previously known as psycik

OpenHAB: Gigabyte AMD A8 BrixOpenHAB with Aeotech ZWave Controller, Raspberry PI, Wemos D1 Mini, Zwave, Xiaomi Humidity and Temperature sensors and Bluetooth LE Sensors
Media:Chromecast v2, ATV4, Roku3, HDHomeRun Dual
Windows 10
Host (Plex Server/Crashplan): 2x2TB, 2x3TB, 1x4TB using DriveBender, Samsung 850 evo 512 GB SSD, Hyper-V Server with 1xW10, 1xW2k8, 2xUbuntu 16.04 LTS, Crashplan, NextPVR channel for Plex,NextPVR Metadata Agent and Scanner for Plex


Mr Snotty
8915 posts

Uber Geek

Moderator
Trusted
Lifetime subscriber

  # 2261364 20-Jun-2019 11:07
Send private message

davidcole:

 

What format are the linux drives once they're in unraid?  One of the big selling points (to me and others) with Storage spaces, drivebender, drive pool, is that the drives remain standard NTFS volumes.  So if the hardware dies, you can just take a drive out and put it in any other windows machines.

 

If that was a consideration for while you were on windows, that might need to be confirmed.

 

 

UnRaid uses XFS but like NTFS, it can be read by Windows (with a driver) or any Linux system. It can also indeed run virtual machines (and has a VM manager built in).

 

Copying from NTFS is a little more tricky but is possible: https://wiki.unraid.net/Copy_files_from_a_NTFS_drive







342 posts

Ultimate Geek


  # 2261387 20-Jun-2019 11:41
Send private message

michaelmurfy:

 

davidcole:

 

What format are the linux drives once they're in unraid?  One of the big selling points (to me and others) with Storage spaces, drivebender, drive pool, is that the drives remain standard NTFS volumes.  So if the hardware dies, you can just take a drive out and put it in any other windows machines.

 

If that was a consideration for while you were on windows, that might need to be confirmed.

 

 

UnRaid uses XFS but like NTFS, it can be read by Windows (with a driver) or any Linux system. It can also indeed run virtual machines (and has a VM manager built in).

 

Copying from NTFS is a little more tricky but is possible: https://wiki.unraid.net/Copy_files_from_a_NTFS_drive

 

 

 

 

In this case - Could I create the array in unraid, boot into windows, load xfs driver, copy data, remove partitions from now empty drives, boot back into unraid, expand array, rinse and repeat?

 

 

 

Or I see I could create a windows VM, and I think assign the ntfs drives to it, then use that to copy...….

 

https://www.youtube.com/watch?v=miYUGWq6l24

 

 


Mr Snotty
8915 posts

Uber Geek

Moderator
Trusted
Lifetime subscriber



342 posts

Ultimate Geek


  # 2261470 20-Jun-2019 12:44
Send private message

Unraid is $89 USD?

 

davidcole did you reckon there was a free version?

 

I see there is a 30 day trial...….




342 posts

Ultimate Geek


  # 2261484 20-Jun-2019 13:45
Send private message

have any of you used www.snapraid.it It looks like it might just replace storage spaces. *ninja edit - doesn't do pooling - just parity. Would need to use drivepool or something.

 

I download unraid, launched it, and realised setting it up is going to be a multi day job - which I just don't have time for at the moment.

 

 

 

For right now I am going to stick with separate drives - as much as it is a pain in the rear.

 

I can't understand why the storage space just stops writing for seconds at a time though - that is super weird. And why the NTFS log file appears to be the culprit.


1764 posts

Uber Geek

Trusted

  # 2261525 20-Jun-2019 15:32
Send private message

I use drivepool with snapraid.





CPU: Intel 3770k| RAM: F3-2400C10D-16GTX G.Skill Trident X |MB:  Gigabyte Z77X-UD5H-WB | GFX: GV-N660OC-2GD gv-n660oc-2gd GeForce GTX 660 | Monitor: Qnix 27" 2560x1440

 

 


1 | 2 | 3 | 4
View this topic in a long page with up to 500 replies per page Create new topic



Twitter and LinkedIn »



Follow us to receive Twitter updates when new discussions are posted in our forums:



Follow us to receive Twitter updates when news items and blogs are posted in our frontpage:



Follow us to receive Twitter updates when tech item prices are listed in our price comparison site:





News »

Chorus to launch Hyperfibre service
Posted 18-Nov-2019 15:00


Microsoft launches first Experience Center worldwide for Asia Pacific in Singapore
Posted 13-Nov-2019 13:08


Disney+ comes to LG Smart TVs
Posted 13-Nov-2019 12:55


Spark launches new wireless broadband "Unplan Metro"
Posted 11-Nov-2019 08:19


Malwarebytes overhauls flagship product with new UI, faster engine and lighter footprint
Posted 6-Nov-2019 11:48


CarbonClick launches into Digital Marketplaces
Posted 6-Nov-2019 11:42


Kordia offers Microsoft Azure Peering Service
Posted 6-Nov-2019 11:41


Spark 5G live on Auckland Harbour for Emirates Team New Zealand
Posted 4-Nov-2019 17:30


BNZ and Vodafone partner to boost NZ Tech for SME
Posted 31-Oct-2019 17:14


Nokia 7.2 available in New Zealand
Posted 31-Oct-2019 16:24


2talk launches Microsoft Teams Direct Routing product
Posted 29-Oct-2019 10:35


New Breast Cancer Foundation app puts power in Kiwi women's hands
Posted 25-Oct-2019 16:13


OPPO Reno2 Series lands, alongside hybrid noise-cancelling Wireless Headphones
Posted 24-Oct-2019 15:32


Waikato Data Scientists awarded $13 million from the Government
Posted 24-Oct-2019 15:27


D-Link launches Wave 2 Unified Access Points
Posted 24-Oct-2019 15:07



Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.


Support Geekzone »

Our community of supporters help make Geekzone possible. Click the button below to join them.

Support Geezone on PressPatron



Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.

Alternatively, you can receive a daily email with Geekzone updates.