Geekzone: technology news, blogs, forums
Guest
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.


JimmyH

2898 posts

Uber Geek
+1 received by user: 1554


#312867 24-May-2024 16:50
Send private message

I have a Windows 10 box that runs as a headless Jellyfin media server. It works great.

 

As part of what it does, it scrapes the metadata for media files, which results is a large number of small files (the metadata directory is only 51GB in total, but currently contains 387,855 files). It's good form to back that up occasionally, as I don't want to have to re-do a bunch of manual matches etc. Plus, I want to back this up before updating Jellyfin, in case something goes wrong.

 

All I want to do is to copy the directory to a USB drive as a backup (or to my NAS across the network), and do this on a regular basis as part of my backup strategy. The size isn't a problem, but Windows file explorer really doesn't like copying that many files - it seems to choke on the sheer number.

 

Is there a good way to do this?


Create new topic
wellygary
8810 posts

Uber Geek
+1 received by user: 5287


  #3234349 24-May-2024 16:55
Send private message

Use 3rd party software to keep to directories matching ??

 

I use "Beyond compare" to keep my NAS files and its backup synced,  - not sure i'm at 300K files but its up there...




MaxineN
Max
2049 posts

Uber Geek
+1 received by user: 1662

ID Verified
Trusted
Subscriber

  #3234351 24-May-2024 16:59
Send private message

Robocopy has a multi threading function and is built into Windows. You'll be at mercy of the IOPS on the external.

Syncthing is another option or rclone if you want constant back ups as it happens.





Ramblings from a mysterious lady who's into tech. Warning I may often create zingers.


JimmyH

2898 posts

Uber Geek
+1 received by user: 1554


  #3234363 24-May-2024 17:39
Send private message

I will look at Robocopy, thanks.

 

Not after directory synching, I want to do backup snapshots. Particularly if I need to roll back after an upgrade of Jellyfin. 




mattwnz
20515 posts

Uber Geek
+1 received by user: 4795


  #3234366 24-May-2024 17:58
Send private message

What about zipping the files , and then copying the zipped file?


gzt

gzt
18672 posts

Uber Geek
+1 received by user: 7809

Lifetime subscriber

  #3234451 24-May-2024 22:01
Send private message

Built in Windows zip feature does a good job zipping a directory of text files.

rhy7s
673 posts

Ultimate Geek
+1 received by user: 147


  #3234495 25-May-2024 08:19
Send private message

As others have said, creating an archive saves on IOPS when writing, here's a quick guide to scheduling 7zip:
https://www.instructables.com/Automatic-File-Backup/

Create new topic








Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.



Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.