Time Machine duplication question (El Capitan and newer)

Macintosh software/hardware discussion and troubleshooting

Moderator: James Steele

Post Reply
User avatar
FMiguelez
Posts: 8266
Joined: Sun Oct 24, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Body: Narco-México Soul/Heart: NYC

Time Machine duplication question (El Capitan and newer)

Post by FMiguelez »

Hello.

I recently renamed and moved to a different folder a folder that has all my video files, and it's more than 400 GB in size. If I do a normal TM backup, it will insist on copying the full 400 GB to the new location, even if it's identical (other than the new main container folder name and location)... A total waste of space and resources.

Is there a way to avoid this in TM?
I would like to safely either, move (not copy) the folder to the new location, or at least be able to delete it from the old location once TM copies it reflecting where it is now.

I understand that moving files manually in the TM backup (regular USB disk) will ruin the database, so I'm hoping there's a safe way to do it via Terminal or even a special program.

Thank you for any thoughts.
Mac Mini Server i7 2.66 GHs/16 GB RAM / OSX 10.14 / DP 9.52
Tascam DM-24, MOTU Track 16, all Spectrasonics' stuff,
Vienna Instruments SUPER PACKAGE, Waves Mercury, slaved iMac and Mac Minis running VEP 7, etc.

---------------------------

"In physics the truth is rarely perfectly clear, and that is certainly universally the case in human affairs. Hence, what is not surrounded by uncertainty cannot be the truth." ― Richard Feynman
User avatar
cuttime
Posts: 4291
Joined: Sun May 15, 2005 10:01 pm
Primary DAW OS: MacOS

Re: Time Machine duplication question (El Capitan and newer)

Post by cuttime »

In Time Machine Preferences>Options>Exclude. :dance:
828x MacOS 13.6.5 M1 Studio Max 1TB 64G DP11.31
User avatar
FMiguelez
Posts: 8266
Joined: Sun Oct 24, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Body: Narco-México Soul/Heart: NYC

Re: Time Machine duplication question (El Capitan and newer)

Post by FMiguelez »

Ha! I thought about that, but then that means it would never get backed up again, even if the content (I add more videos to the source) does change. I obviously wouldn't want that. I need it to keep backing up normally.
And the backup is supposed to reflect the source to perfection, so that option might not work too well.

But thanks for your thoughts. Any other ideas appreciated :)
Mac Mini Server i7 2.66 GHs/16 GB RAM / OSX 10.14 / DP 9.52
Tascam DM-24, MOTU Track 16, all Spectrasonics' stuff,
Vienna Instruments SUPER PACKAGE, Waves Mercury, slaved iMac and Mac Minis running VEP 7, etc.

---------------------------

"In physics the truth is rarely perfectly clear, and that is certainly universally the case in human affairs. Hence, what is not surrounded by uncertainty cannot be the truth." ― Richard Feynman
User avatar
MIDI Life Crisis
Posts: 26254
Joined: Wed May 18, 2005 10:01 pm
Primary DAW OS: MacOS
Contact:

Re: Time Machine duplication question (El Capitan and newer)

Post by MIDI Life Crisis »

What I would do (and have done) is move the folder to where you want it. If you want the new folder backed up and, let it do it's thing or, as above, exclude it. If you no longer want the old folder, you can delete that folder from Machine. I'm not clear what it is your asking. Either you backup an item or you don't. What's the problem? Which folder don't you want to backup? Want them both backed up, then that's what's happening. If you don't, exclude the one you don't want backed up, But you can't copy a folder and mirror it in Machine. They are separate items and will be treated that way, at least as far as i understand the way TM works.
2013 Mac Pro 32GB RAM

OSX 10.14.6; DP 10; Track 16; Finale 26, iPad Pro, et al

MIDI LIFE CRISIS
User avatar
cuttime
Posts: 4291
Joined: Sun May 15, 2005 10:01 pm
Primary DAW OS: MacOS

Re: Time Machine duplication question (El Capitan and newer)

Post by cuttime »

MIDI Life Crisis wrote: But you can't copy a folder and mirror it in Machine. They are separate items and will be treated that way, at least as far as i understand the way TM works.
What MLC said. Either you have a backup or you don't. The other alternative I see is to wipe the backup and start from scratch. Another possibility is to perhaps create an alias? I really don't know how TM handles aliases (or symbolic links). Worth a shot anybody?
https://www.howtogeek.com/297721/how-to ... -on-a-mac/
828x MacOS 13.6.5 M1 Studio Max 1TB 64G DP11.31
User avatar
FMiguelez
Posts: 8266
Joined: Sun Oct 24, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Body: Narco-México Soul/Heart: NYC

Re: Time Machine duplication question (El Capitan and newer)

Post by FMiguelez »

If I let TM do its thing normally, since I changed the main folder name and moved it to a new location in the computer, TM will think that the content changed (it didn't) and it will want to copy it again to the new location with the new name.
That alone would eat up 1/3 of the drive space for an unnecessary and redundant copy.

I want to be able to either, safely delete from TM the original copy of the folder in the original location with the original name, or better yet, tell TM to NOT copy the whole folder again and simply move it from where it is, to avoid the duplication. That would save me 400 GB of space.

But I'm afraid to do any of that manually because I heard that moving and deleting TM files around breaks havoc in its database and basically ruins everything.

I know it's supposedly going to delete that folder when it seeks new space as the disk gets full, but I'd like to see if I can do what I described. It's much more efficient. And I want to have the option to decide what gets deleted when that happens, not the machine.
Mac Mini Server i7 2.66 GHs/16 GB RAM / OSX 10.14 / DP 9.52
Tascam DM-24, MOTU Track 16, all Spectrasonics' stuff,
Vienna Instruments SUPER PACKAGE, Waves Mercury, slaved iMac and Mac Minis running VEP 7, etc.

---------------------------

"In physics the truth is rarely perfectly clear, and that is certainly universally the case in human affairs. Hence, what is not surrounded by uncertainty cannot be the truth." ― Richard Feynman
User avatar
cuttime
Posts: 4291
Joined: Sun May 15, 2005 10:01 pm
Primary DAW OS: MacOS

Re: Time Machine duplication question (El Capitan and newer)

Post by cuttime »

You could try this YMMV:
TimeTracker
https://www.charlessoft.com
828x MacOS 13.6.5 M1 Studio Max 1TB 64G DP11.31
User avatar
MIDI Life Crisis
Posts: 26254
Joined: Wed May 18, 2005 10:01 pm
Primary DAW OS: MacOS
Contact:

Re: Time Machine duplication question (El Capitan and newer)

Post by MIDI Life Crisis »

So why not let TM back up the new folder and the delete the original from TM when done?
2013 Mac Pro 32GB RAM

OSX 10.14.6; DP 10; Track 16; Finale 26, iPad Pro, et al

MIDI LIFE CRISIS
User avatar
mikehalloran
Posts: 15134
Joined: Sun Jan 25, 2009 5:08 pm
Primary DAW OS: MacOS
Location: Sillie Con Valley

Re: Time Machine duplication question (El Capitan and newer)

Post by mikehalloran »

MIDI Life Crisis wrote:So why not let TM back up the new folder and the delete the original from TM when done?
TM deletes old backups when the disk gets full. You can delete the oldest ones manually but there’s no real reason to do so.
DP 11.31; 828mkII FW, micro lite, M4, MTP/AV USB Firmware 2.0.1
2023 Mac Studio M2 8TB, 192GB RAM, OS Sonoma 14.4, USB4 8TB external, M-Audio AIR 192|14, Mackie ProFxv3 6/10/12; 2012 MBPs Catalina, Mojave
IK-NI-Izotope-PSP-Garritan-Antares, LogicPro X, Finale 27.4, Dorico 5.2, Notion 6, Overture 5, TwistedWave, DSP-Q 5, SmartScore64 Pro, Toast 20 Pro
User avatar
HCMarkus
Posts: 9712
Joined: Tue Jan 10, 2006 9:01 am
Primary DAW OS: MacOS
Location: Rancho Bohemia, California
Contact:

Re: Time Machine duplication question (El Capitan and newer)

Post by HCMarkus »

My first thought: consider all the money and time you spend creating, then move the folder and let Time Machine go to town. Sure it's redundant. Buy a new Time Machine drive when this one fils up.

What's 400GB between friends when an 8TB HD can be had for $150? (calculated, it is $7.50)

https://www.amazon.com/Seagate-External ... hard+drive

Alternately, move the current Video Folder, exclude it from TM backups in Options, and create a new Video Folder 2 (not excluded from TM backups) to house additions to your video collection.

Feliz Navidad Amigo!
User avatar
FMiguelez
Posts: 8266
Joined: Sun Oct 24, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Body: Narco-México Soul/Heart: NYC

Re: Time Machine duplication question (El Capitan and newer)

Post by FMiguelez »

MIDI Life Crisis wrote:So why not let TM back up the new folder and the delete the original from TM when done?
Because I heard doing that would ruin TM's database...

But maybe I'm mistaken,and it's perfectly fine to do it, and that's why my question sounded silly? :?
mikehalloran wrote:
MIDI Life Crisis wrote:So why not let TM back up the new folder and the delete the original from TM when done?
TM deletes old backups when the disk gets full. You can delete the oldest ones manually but there’s no real reason to do so.
Wow. So I was mistaken...
I didn't know you could do that without messing up the backup.
Now I wonder where the hell I got that idea from? :?

So if I can manually delete old stuff from TM safely, I do just that.
HCMarkus wrote:My first thought: consider all the money and time you spend creating, then move the folder and let Time Machine go to town. Sure it's redundant. Buy a new Time Machine drive when this one fils up.

What's 400GB between friends when an 8TB HD can be had for $150? (calculated, it is $7.50)
I guess I just don't like waste when it's avoidable :)

But even then, my stupid folder alone would waste, overnight, almost a full TB between the original and the copy from your above system. Only 7/8s left to go... 1/16th being completely wasted for duplication.

But I do like your other last idea with the second folder.

And I like it that I was wrong and one CAN delete older files from TM :dance:

Thank you guys!
Mac Mini Server i7 2.66 GHs/16 GB RAM / OSX 10.14 / DP 9.52
Tascam DM-24, MOTU Track 16, all Spectrasonics' stuff,
Vienna Instruments SUPER PACKAGE, Waves Mercury, slaved iMac and Mac Minis running VEP 7, etc.

---------------------------

"In physics the truth is rarely perfectly clear, and that is certainly universally the case in human affairs. Hence, what is not surrounded by uncertainty cannot be the truth." ― Richard Feynman
User avatar
FMiguelez
Posts: 8266
Joined: Sun Oct 24, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Body: Narco-México Soul/Heart: NYC

Re: Time Machine duplication question (El Capitan and newer)

Post by FMiguelez »

Aha!

So, turns out, I was only partially incorrect. There IS a right and a wrong way of deleting TM files from the drive.

I was just about to deleting them from the Finder, but something didn't feel right... So I did a little research and one must do it from within the Time Machine interface. Then one can delete away, with the proper caution, of course.

http://osxdaily.com/2013/08/06/remove-i ... -mac-os-x/

and

https://www.cnet.com/how-to/how-to-clea ... e-backups/

This is intended for rare cases like the one I mentioned in the OP.
But I'm glad I brought this up, since I had been living with a misconception about TM since forever. All this was new to me. I learned something cool today.

Thanks guys!
Mac Mini Server i7 2.66 GHs/16 GB RAM / OSX 10.14 / DP 9.52
Tascam DM-24, MOTU Track 16, all Spectrasonics' stuff,
Vienna Instruments SUPER PACKAGE, Waves Mercury, slaved iMac and Mac Minis running VEP 7, etc.

---------------------------

"In physics the truth is rarely perfectly clear, and that is certainly universally the case in human affairs. Hence, what is not surrounded by uncertainty cannot be the truth." ― Richard Feynman
User avatar
HCMarkus
Posts: 9712
Joined: Tue Jan 10, 2006 9:01 am
Primary DAW OS: MacOS
Location: Rancho Bohemia, California
Contact:

Re: Time Machine duplication question (El Capitan and newer)

Post by HCMarkus »

Good info!

Btw, if you excluded the original folder from tm, you’d waste only 400gb. Regardless, the solution you found is superior!
Post Reply