What are my options to sync large files on my LAN?

Macintosh software/hardware discussion and troubleshooting

Moderator: James Steele

Post Reply
User avatar
FMiguelez
Posts: 8266
Joined: Sun Oct 24, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Body: Narco-México Soul/Heart: NYC

What are my options to sync large files on my LAN?

Post by FMiguelez »

Hello.

I have a folder with VERY large files (old Gigastudio files and some .wav loops) that I'm using with Machfive 3 and Stylus RMX.

What I want is to have it available in my slave computers (iMac and MacMini with Lion Server).
Since I might make changes to the files in that folder in either computer, I'd like them to synchronize automatically (instead of remembering what the changes were on each and copying them to one another).

Using Dropbox for this is totally out of the question, of course. The last thing I want is to upload that to their servers constantly (besides, the folder is like 90 GBs, so no room there for me).

- Is there a way to sync them wirelessly inside my LAN WITHOUT having to sync them to some cloud service?
- I have Lion Server, so could I do it using that computer? Isn't that implied on its name?

If so, could you point me to the relevant concepts I should investigate?

So what I want is basically something like Dropbox, but without having to upload anything to a cloud service.

Thank you!
Mac Mini Server i7 2.66 GHs/16 GB RAM / OSX 10.14 / DP 9.52
Tascam DM-24, MOTU Track 16, all Spectrasonics' stuff,
Vienna Instruments SUPER PACKAGE, Waves Mercury, slaved iMac and Mac Minis running VEP 7, etc.

---------------------------

"In physics the truth is rarely perfectly clear, and that is certainly universally the case in human affairs. Hence, what is not surrounded by uncertainty cannot be the truth." ― Richard Feynman
User avatar
cuttime
Posts: 4516
Joined: Sun May 15, 2005 10:01 pm
Primary DAW OS: MacOS

Re: What are my options to sync large files on my LAN?

Post by cuttime »

I haven't used this, but I think it might do what you want:

http://www.econtechnologies.com/pages/c ... rview.html
828x MacOS 15.5 M1 Studio Max 1TB 64G DP11.34
User avatar
FMiguelez
Posts: 8266
Joined: Sun Oct 24, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Body: Narco-México Soul/Heart: NYC

Re: What are my options to sync large files on my LAN?

Post by FMiguelez »

Thank you, CutTime.

That looks about right!
It seems to be a little over-the-top for what I need, but apparently I can test drive it before buying it, so I will definitely give it a try. What I can tell from your link is that I could easily sync my .gig folder to my Macs, just like I wanted 8)

I still wonder if this is not something I could already do with Lion Server... Isn't that what servers do?
This is an area where I'm a neophyte, but I'm willing to learn it if it's already there with what I have.
Mac Mini Server i7 2.66 GHs/16 GB RAM / OSX 10.14 / DP 9.52
Tascam DM-24, MOTU Track 16, all Spectrasonics' stuff,
Vienna Instruments SUPER PACKAGE, Waves Mercury, slaved iMac and Mac Minis running VEP 7, etc.

---------------------------

"In physics the truth is rarely perfectly clear, and that is certainly universally the case in human affairs. Hence, what is not surrounded by uncertainty cannot be the truth." ― Richard Feynman
User avatar
mikehalloran
Posts: 16258
Joined: Sun Jan 25, 2009 5:08 pm
Primary DAW OS: MacOS
Location: Sillie Con Valley

Re: What are my options to sync large files on my LAN?

Post by mikehalloran »

This is something that we were promised in Lion but I think Apple wants us to use iCloud. I'll ask my daughter's bf when I see him in a day or two, if there's another way. He tests things like this as part of his job.
DP 11.34; 828mkII FW, micro lite, M4, MTP/AV USB Firmware 2.0.1
2023 Mac Studio M2 8TB, 192GB RAM, OS Sequoia 15.4, USB4 8TB externals, Neumann MT48, M-Audio AIR 192|14, Mackie ProFxv3, Zoom F3 & UAC 232 32bit float recorder & interface; 2012 MBPs (x2) Catalina, Mojave
IK-NI-Izotope-PSP-Garritan-Antares, LogicPro X, Finale 27.4, Dorico 5, Notion 6, Overture 5, TwistedWave, DSP-Q 5, SmartScore64 NE Pro, Toast 20 Pro
User avatar
FMiguelez
Posts: 8266
Joined: Sun Oct 24, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Body: Narco-México Soul/Heart: NYC

Re: What are my options to sync large files on my LAN?

Post by FMiguelez »

Yeah... I haven't found anything useful in Lion's documentation (that I know of).

It seems Apple REALLY wants us to use the damned cloud.
I mean, it's fine only for certain things, but not for such large files. Besides, my internet upload connection is like 10x slower than downloading, so uploading takes for ever. Using the cloud for this would be totally inefficient and annoying :roll:

I'll certainly appreciate it if you ask your daughter 8)

Thanks!
Mac Mini Server i7 2.66 GHs/16 GB RAM / OSX 10.14 / DP 9.52
Tascam DM-24, MOTU Track 16, all Spectrasonics' stuff,
Vienna Instruments SUPER PACKAGE, Waves Mercury, slaved iMac and Mac Minis running VEP 7, etc.

---------------------------

"In physics the truth is rarely perfectly clear, and that is certainly universally the case in human affairs. Hence, what is not surrounded by uncertainty cannot be the truth." ― Richard Feynman
User avatar
zaratero
Posts: 453
Joined: Tue Aug 05, 2008 4:50 pm
Primary DAW OS: MacOS
Location: Gasteiz

Re: What are my options to sync large files on my LAN?

Post by zaratero »

There is an opensource free option which works in windows as well:
http://www.cis.upenn.edu/~bcpierce/unison/
I haven tried it.

For smaller folders bear in mind that dropbox does LAN sync now, so while it does upload to the cloud, files are available through LAN to other computers faster.
http://www.cueaudio.org
Macpro 3.1 Octocore-16Gb RAM-OSX10.8 - DP 7.24
Macbook pro Core2Duo-4Gb RAM-OSX10.6 - DP 7.24
NazRat
Posts: 1214
Joined: Sat Feb 07, 2009 1:55 pm
Primary DAW OS: Unspecified

Re: What are my options to sync large files on my LAN?

Post by NazRat »

Something from the app store:

http://itunes.apple.com/us/app/folderwa ... 4368?mt=12

Not quite sure how it would push back changes on the satellite boxes, but may be worth a look.
DP8.06 PT11.2.0 VEP 5.3.x
828mkII 828mk3 ADA8000 MTP-AV Komplete Audio 6
Mac Mini Quad 10.9.4 - HP Quad Laptop Win 8.1
User avatar
mikehalloran
Posts: 16258
Joined: Sun Jan 25, 2009 5:08 pm
Primary DAW OS: MacOS
Location: Sillie Con Valley

Re: What are my options to sync large files on my LAN?

Post by mikehalloran »

I talked to future son-in-law this evening. He recommended hosting everything on the server. When I explained the issue to him, he said that the OS X server does not have the functionality but that there are a few utilities that do.

He was telling me that many Apple engineers, including himself prefer Google Disk to iCloud. Like iCloud, the first 5G is free. He tells me it is faster and not application specific like iCloud.
DP 11.34; 828mkII FW, micro lite, M4, MTP/AV USB Firmware 2.0.1
2023 Mac Studio M2 8TB, 192GB RAM, OS Sequoia 15.4, USB4 8TB externals, Neumann MT48, M-Audio AIR 192|14, Mackie ProFxv3, Zoom F3 & UAC 232 32bit float recorder & interface; 2012 MBPs (x2) Catalina, Mojave
IK-NI-Izotope-PSP-Garritan-Antares, LogicPro X, Finale 27.4, Dorico 5, Notion 6, Overture 5, TwistedWave, DSP-Q 5, SmartScore64 NE Pro, Toast 20 Pro
User avatar
zaratero
Posts: 453
Joined: Tue Aug 05, 2008 4:50 pm
Primary DAW OS: MacOS
Location: Gasteiz

Re: What are my options to sync large files on my LAN?

Post by zaratero »

sorry for the OT, but responding to Mike:

I am testing google drive for the last week and I am very impressed.
I have used Dropbox (never icloud) since it was beta, and have over 8 GBs of free storage there, but I am considering moving over to Drive.

I use google apps extensively and the integration to gmail alone is very sweet. The ability to add notes and visit revisions in a much fancier and handy way than dropbox is the big bonus for me. The inability to recover deleted files from the cloud in google drive the biggest Dropbox bonus. If it holds like this for a couple of months, with no errors ( Dropbox was not reliable for me at the beginning), I am sold.
http://www.cueaudio.org
Macpro 3.1 Octocore-16Gb RAM-OSX10.8 - DP 7.24
Macbook pro Core2Duo-4Gb RAM-OSX10.6 - DP 7.24
User avatar
FutureLegends
Posts: 1403
Joined: Sun Oct 17, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Berlin, Germany
Contact:

Re: What are my options to sync large files on my LAN?

Post by FutureLegends »

I know we used to do this in the graphics biz years ago... Not sure Gigabit ethernet is fast enough for audio though, but... If you have a server, couldn't you have the files stored on that and have the other computers access that drive through the LAN? Thus all computers would use the same files and there would be no need to sync.
Just a thought.
Hackintosh 6-Core 3.7ghz/32gb ram, macOS Mojave
Hardware: Apollo 8, Apollo 8p, Apollo Twin mkII, MOTU 828mk3 & Original 828 | UA LA-610 | Vanguard V13 Tube Mic | MindPrint En-Voice | Genelec M040AM | Gretsch Guitars & Drums
Software: DP8 | FCPX | Logic Pro X | Play
| EWQL Gypsy, Choirs, Orchestra Gold, VoP | EZDrummer w/ Twizted Kit | Action Strings
User avatar
mikehalloran
Posts: 16258
Joined: Sun Jan 25, 2009 5:08 pm
Primary DAW OS: MacOS
Location: Sillie Con Valley

Re: What are my options to sync large files on my LAN?

Post by mikehalloran »

FutureLegends wrote:I know we used to do this in the graphics biz years ago... Not sure Gigabit ethernet is fast enough for audio though, but... If you have a server, couldn't you have the files stored on that and have the other computers access that drive through the LAN? Thus all computers would use the same files and there would be no need to sync.
Just a thought.
Well it's faster than FW800. That's exactly what my daughter's bf suggested.

I've never explored distributed computing so I have no advice to give. That's why I asked around.
DP 11.34; 828mkII FW, micro lite, M4, MTP/AV USB Firmware 2.0.1
2023 Mac Studio M2 8TB, 192GB RAM, OS Sequoia 15.4, USB4 8TB externals, Neumann MT48, M-Audio AIR 192|14, Mackie ProFxv3, Zoom F3 & UAC 232 32bit float recorder & interface; 2012 MBPs (x2) Catalina, Mojave
IK-NI-Izotope-PSP-Garritan-Antares, LogicPro X, Finale 27.4, Dorico 5, Notion 6, Overture 5, TwistedWave, DSP-Q 5, SmartScore64 NE Pro, Toast 20 Pro
User avatar
FMiguelez
Posts: 8266
Joined: Sun Oct 24, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Body: Narco-México Soul/Heart: NYC

Re: What are my options to sync large files on my LAN?

Post by FMiguelez »

Thank you all for your responses.

I will investigate them all to find out what's best for me.

That Chronosync thingie looks quite good. I've read a little about it, but it seems one needs to dedicate some time to understand it and use it properly.

One more item in my endless to-learn list...
Mac Mini Server i7 2.66 GHs/16 GB RAM / OSX 10.14 / DP 9.52
Tascam DM-24, MOTU Track 16, all Spectrasonics' stuff,
Vienna Instruments SUPER PACKAGE, Waves Mercury, slaved iMac and Mac Minis running VEP 7, etc.

---------------------------

"In physics the truth is rarely perfectly clear, and that is certainly universally the case in human affairs. Hence, what is not surrounded by uncertainty cannot be the truth." ― Richard Feynman
Post Reply