Why are autosave files so much smaller?

Discussion of Digital Performer use, optimization, tips and techniques on MacOS.

Moderator: James Steele

Forum rules
This forum is for most discussion related to the use and optimization of Digital Performer [MacOS] and plug-ins as well as tips and techniques. It is NOT for troubleshooting technical issues, complaints, feature requests, or "Comparative DAW 101."
User avatar
philbrown
Posts: 2366
Joined: Fri Nov 05, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Almost Mexico

Why are autosave files so much smaller?

Post by philbrown »

Distantly related to Shooshie's story about hold 'em/fold 'em I had been carrying forward a file for years, re-naming and re-using it as a new starting place for each week's job. Long story short, I just started using autosave and immediately noticed how much smaller the autosave file was, in comparison with the original - in one case a TENTH of the size! I started thinking about what could cause that and theorized it might be undo history. Then I looked at the Undo History preferences and realized I'd never changed the factory default and seems like the default settings would add up to a lot of cumulative bloat over time.
Anyone have any experience or thoughts about this?

I could not find any mention whatsoever of Autosave in the DP 7 manual.
2020 iMac 27" 3.6GHz 10 core i9 • Mac OS 12.2.1 • DP 11.04 • UAD-8 Octo card • Midas M32R

Plugs: UAD•Slate•Scuffham•Flux IRCAM•NI Komplete•Klanghelm•Waves•Spectrasonics•Arturia•Soundtoys•Nomad Factory•PSP•Stillwell•Cytomic•Korg•Five12•GForce
User avatar
FMiguelez
Posts: 8266
Joined: Sun Oct 24, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Body: Narco-México Soul/Heart: NYC

Re: Why are autosave files so much smaller?

Post by FMiguelez »

I've always assumed the undo history is part of the autosaved DP file.
I've never noticed those files being any smaller than the original. I'll check how it is with mine when I fire up DP later today.
Mac Mini Server i7 2.66 GHs/16 GB RAM / OSX 10.14 / DP 9.52
Tascam DM-24, MOTU Track 16, all Spectrasonics' stuff,
Vienna Instruments SUPER PACKAGE, Waves Mercury, slaved iMac and Mac Minis running VEP 7, etc.

---------------------------

"In physics the truth is rarely perfectly clear, and that is certainly universally the case in human affairs. Hence, what is not surrounded by uncertainty cannot be the truth." ― Richard Feynman
User avatar
philbrown
Posts: 2366
Joined: Fri Nov 05, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Almost Mexico

Re: Why are autosave files so much smaller?

Post by philbrown »

I'm seeing now where even if I start a fresh file and work on it for a few hours the autosave file is always way smaller.

It's funny, I was looking at SSD drives to improve load times and such, and by setting aside older files and using the the much smaller autosave files my load times are WAY quicker with no hardware $$ needed.
2020 iMac 27" 3.6GHz 10 core i9 • Mac OS 12.2.1 • DP 11.04 • UAD-8 Octo card • Midas M32R

Plugs: UAD•Slate•Scuffham•Flux IRCAM•NI Komplete•Klanghelm•Waves•Spectrasonics•Arturia•Soundtoys•Nomad Factory•PSP•Stillwell•Cytomic•Korg•Five12•GForce
User avatar
buzzsmith
Posts: 3097
Joined: Mon Dec 27, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Houston
Contact:

Re: Why are autosave files so much smaller?

Post by buzzsmith »

Are you doing any audio, Phil, on your projects that the Autosave files are smaller?

Just guessing that the AS files may not actually include the audio and contain just pointers.

Dunno...I guess I'll have to go look for myself!

Buzzy
Early 2009 Mac Pro 4,1>5,1 3.33 GHz Hex Core Intel Xeon OS X 10.8.5 SSD (32 gigs RAM)
DP 9.51 PCI-424e / original 2408, 2408mkII, 24I/O, MTP-AV

Yamaha C7 Conservatory Grand
Hammond B-3 / Leslie 145
Focal Twin6 Be(s)

User avatar
philbrown
Posts: 2366
Joined: Fri Nov 05, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Almost Mexico

Re: Why are autosave files so much smaller?

Post by philbrown »

buzzsmith wrote:Are you doing any audio, Phil, on your projects that the Autosave files are smaller?

Just guessing that the AS files may not actually include the audio and contain just pointers.

Dunno...I guess I'll have to go look for myself!

Buzzy
Yes there are usually 3 hour long stereo files in the work I do, but when I trash the original and use the autosave file, there's nothing lost at all that I can see. The only difference is the load time is so much faster, and DP seems to be a little "snappier". The original DP can't contain all the audio info as the DP file would be gigabytes instead of MB's in this case.
2020 iMac 27" 3.6GHz 10 core i9 • Mac OS 12.2.1 • DP 11.04 • UAD-8 Octo card • Midas M32R

Plugs: UAD•Slate•Scuffham•Flux IRCAM•NI Komplete•Klanghelm•Waves•Spectrasonics•Arturia•Soundtoys•Nomad Factory•PSP•Stillwell•Cytomic•Korg•Five12•GForce
User avatar
buzzsmith
Posts: 3097
Joined: Mon Dec 27, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Houston
Contact:

Re: Why are autosave files so much smaller?

Post by buzzsmith »

philbrown wrote:Yes there are usually 3 hour long stereo files in the work I do, but when I trash the original and use the autosave file, there's nothing lost at all that I can see. The only difference is the load time is so much faster, and DP seems to be a little "snappier". The original DP can't contain all the audio info as the DP file would be gigabytes instead of MB's in this case.
When you say "trash the original", you are disposing of the DP file, but not the audio folder within the project folder?

So (maybe) the audio is still being pointed to by a DP Autosave file.

Now, I HAVE to go look for myself! :)

Buzzy
Early 2009 Mac Pro 4,1>5,1 3.33 GHz Hex Core Intel Xeon OS X 10.8.5 SSD (32 gigs RAM)
DP 9.51 PCI-424e / original 2408, 2408mkII, 24I/O, MTP-AV

Yamaha C7 Conservatory Grand
Hammond B-3 / Leslie 145
Focal Twin6 Be(s)

User avatar
philbrown
Posts: 2366
Joined: Fri Nov 05, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Almost Mexico

Re: Why are autosave files so much smaller?

Post by philbrown »

buzzsmith wrote:
When you say "trash the original", you are disposing of the DP file, but not the audio folder within the project folder?

So (maybe) the audio is still being pointed to by a DP Autosave file.

Buzzy
Yes to your questions, Buzzy. The DP folder is the same, I'm just taking the single original DP file itself, removing it from the folder, removing "autsosave" suffix from the autosave file (that's already in the folder) and using that in place of the original. Everything else, audio files, analysis files, etc unchanged. In my case, on different types of files, the autosave has ranged from 1/2 to 1/10 of the original file size.

I'll do some more testing and observation when I have more non-work time. I just thought 1. someone might know more of what's going on here behind the scenes (maybe some Magic person) and 2. It seems to be a really easy way to trim file size, load/save time and I swear even bounces seem to be going noticeably faster. I haven't found a down side or anything missing so far. Obviously cover your butt and don't trash anything valuable or irreplaceable on my advice though!
2020 iMac 27" 3.6GHz 10 core i9 • Mac OS 12.2.1 • DP 11.04 • UAD-8 Octo card • Midas M32R

Plugs: UAD•Slate•Scuffham•Flux IRCAM•NI Komplete•Klanghelm•Waves•Spectrasonics•Arturia•Soundtoys•Nomad Factory•PSP•Stillwell•Cytomic•Korg•Five12•GForce
User avatar
MIDI Life Crisis
Posts: 26254
Joined: Wed May 18, 2005 10:01 pm
Primary DAW OS: MacOS
Contact:

Re: Why are autosave files so much smaller?

Post by MIDI Life Crisis »

I'd like to know what's causing the original file to be bloated in the first place.
2013 Mac Pro 32GB RAM

OSX 10.14.6; DP 10; Track 16; Finale 26, iPad Pro, et al

MIDI LIFE CRISIS
Killahurts
Posts: 2188
Joined: Thu Jan 13, 2005 10:01 pm
Primary DAW OS: MacOS
Location: USA

Re: Why are autosave files so much smaller?

Post by Killahurts »

My theory is, that the Autosave files have some kind of compression applied when they are made, to make them smaller on purpose.. It makes sense really, because one might build up hundreds of Autosaves, and that would eventually become wasteful of HD space. When you open an Autosave, it would expand back out (the compression would be lossless).
DP11, 2019 16-Core Mac Pro, Monterey, 64GB RAM. RME HDSPe MADI FX to SSL Alphalink to SSL Matrix console, and multiple digital sub consoles. UAD Quad PCIe. Outboard stuff.
User avatar
buzzsmith
Posts: 3097
Joined: Mon Dec 27, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Houston
Contact:

Re: Why are autosave files so much smaller?

Post by buzzsmith »

Well, curiosity got the best of me so I checked a few...
(All are 22 Autosaves per song.)

Song 1: 5.5 MB - - - 1.75 GB in the Audio Folder
Autosaves: Most Recent: 496 KB...oldest (2 days ago) 1.7 MB

Song 2: 3.6 MB - - - 742 MB in the Audio Folder
Autosaves: Most recent: 2.7 MB...oldest (6 days ago) 2.7 MB

Song 3: 3.7 MB - - - 1.25 GB in the Audio Folder
Autosaves: Most recent: 393 KB...oldest (30 days ago) 664 KB

So, I'm not sure what this means other than to verify what Phil is seeing.

Buzzy
Early 2009 Mac Pro 4,1>5,1 3.33 GHz Hex Core Intel Xeon OS X 10.8.5 SSD (32 gigs RAM)
DP 9.51 PCI-424e / original 2408, 2408mkII, 24I/O, MTP-AV

Yamaha C7 Conservatory Grand
Hammond B-3 / Leslie 145
Focal Twin6 Be(s)

User avatar
philbrown
Posts: 2366
Joined: Fri Nov 05, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Almost Mexico

Re: Why are autosave files so much smaller?

Post by philbrown »

Answer: UNDO HISTORY. That's the only difference I see.

A simple DP file: 16.1 MB
Same file.autosave: 254KB
Same autosave file re-saved with no changes except name change: 254KB
(eliminates some kind of autosave-specific compression, which I thought was extremely unlikely anyway).

The only difference I can find is Undo History - it's been emptied out in the autosave files.
If you save versions as you go like I do, you might consider changing Undo History prefs to save some unneeded file bloat.
2020 iMac 27" 3.6GHz 10 core i9 • Mac OS 12.2.1 • DP 11.04 • UAD-8 Octo card • Midas M32R

Plugs: UAD•Slate•Scuffham•Flux IRCAM•NI Komplete•Klanghelm•Waves•Spectrasonics•Arturia•Soundtoys•Nomad Factory•PSP•Stillwell•Cytomic•Korg•Five12•GForce
User avatar
bayswater
Posts: 11981
Joined: Fri Feb 16, 2007 9:06 pm
Primary DAW OS: MacOS
Location: Vancouver

Re: Why are autosave files so much smaller?

Post by bayswater »

philbrown wrote:Answer: UNDO HISTORY. That's the only difference I see.
---
If you save versions as you go like I do, you might consider changing Undo History prefs to save some unneeded file bloat.
I would have hoped autosave would relieve us of the need to constantly save versions of a project by including the undo history. If we still need to do that, autosave is pretty pointless.
2018 Mini i7 32G 10.14.6, DP 11.3, Mixbus 9, Logic 10.5, Scarlett 18i8
User avatar
philbrown
Posts: 2366
Joined: Fri Nov 05, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Almost Mexico

Re: Why are autosave files so much smaller?

Post by philbrown »

bayswater wrote:
philbrown wrote:Answer: UNDO HISTORY. That's the only difference I see.
---
If you save versions as you go like I do, you might consider changing Undo History prefs to save some unneeded file bloat.
I would have hoped autosave would relieve us of the need to constantly save versions of a project by including the undo history. If we still need to do that, autosave is pretty pointless.
It just depends on how you like to work and save things I think. I feel like I'm better informed about choices though and how to set my preferences accordingly. I personally am looking at autosave more as a failsafe if I have forgotten to save the last hour and DP folds up its tent (and that NEVER happens after I have just saved) so I haven't lost an hour of PITA editing or whatever. At least we know now that autosaves have no undo history, in case you were depending on the fact that it did.
2020 iMac 27" 3.6GHz 10 core i9 • Mac OS 12.2.1 • DP 11.04 • UAD-8 Octo card • Midas M32R

Plugs: UAD•Slate•Scuffham•Flux IRCAM•NI Komplete•Klanghelm•Waves•Spectrasonics•Arturia•Soundtoys•Nomad Factory•PSP•Stillwell•Cytomic•Korg•Five12•GForce
User avatar
FMiguelez
Posts: 8266
Joined: Sun Oct 24, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Body: Narco-México Soul/Heart: NYC

Re: Why are autosave files so much smaller?

Post by FMiguelez »

I just checked some DP files, and the regular file equals the corresponding autosaved file in size.

For instance, my empty template (no audio) currently is 24 MBs, just like the autosaved versions. If I dump the undo history, the file size still matches both version (regular and autosaved).
Mac Mini Server i7 2.66 GHs/16 GB RAM / OSX 10.14 / DP 9.52
Tascam DM-24, MOTU Track 16, all Spectrasonics' stuff,
Vienna Instruments SUPER PACKAGE, Waves Mercury, slaved iMac and Mac Minis running VEP 7, etc.

---------------------------

"In physics the truth is rarely perfectly clear, and that is certainly universally the case in human affairs. Hence, what is not surrounded by uncertainty cannot be the truth." ― Richard Feynman
User avatar
philbrown
Posts: 2366
Joined: Fri Nov 05, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Almost Mexico

Re: Why are autosave files so much smaller?

Post by philbrown »

FMiguelez wrote:I just checked some DP files, and the regular file equals the corresponding autosaved file in size.

For instance, my empty template (no audio) currently is 24 MBs, just like the autosaved versions. If I dump the undo history, the file size still matches both version (regular and autosaved).
Weird! Not at all what Buzzy and I are seeing. I haven't got a clue...
2020 iMac 27" 3.6GHz 10 core i9 • Mac OS 12.2.1 • DP 11.04 • UAD-8 Octo card • Midas M32R

Plugs: UAD•Slate•Scuffham•Flux IRCAM•NI Komplete•Klanghelm•Waves•Spectrasonics•Arturia•Soundtoys•Nomad Factory•PSP•Stillwell•Cytomic•Korg•Five12•GForce
Post Reply