Why are autosave files so much smaller?
Moderator: James Steele
Forum rules
This forum is for most discussion related to the use and optimization of Digital Performer [MacOS] and plug-ins as well as tips and techniques. It is NOT for troubleshooting technical issues, complaints, feature requests, or "Comparative DAW 101."
This forum is for most discussion related to the use and optimization of Digital Performer [MacOS] and plug-ins as well as tips and techniques. It is NOT for troubleshooting technical issues, complaints, feature requests, or "Comparative DAW 101."
- philbrown
- Posts: 2366
- Joined: Fri Nov 05, 2004 10:01 pm
- Primary DAW OS: MacOS
- Location: Almost Mexico
Why are autosave files so much smaller?
Distantly related to Shooshie's story about hold 'em/fold 'em I had been carrying forward a file for years, re-naming and re-using it as a new starting place for each week's job. Long story short, I just started using autosave and immediately noticed how much smaller the autosave file was, in comparison with the original - in one case a TENTH of the size! I started thinking about what could cause that and theorized it might be undo history. Then I looked at the Undo History preferences and realized I'd never changed the factory default and seems like the default settings would add up to a lot of cumulative bloat over time.
Anyone have any experience or thoughts about this?
I could not find any mention whatsoever of Autosave in the DP 7 manual.
Anyone have any experience or thoughts about this?
I could not find any mention whatsoever of Autosave in the DP 7 manual.
2020 iMac 27" 3.6GHz 10 core i9 • Mac OS 12.2.1 • DP 11.04 • UAD-8 Octo card • Midas M32R
Plugs: UAD•Slate•Scuffham•Flux IRCAM•NI Komplete•Klanghelm•Waves•Spectrasonics•Arturia•Soundtoys•Nomad Factory•PSP•Stillwell•Cytomic•Korg•Five12•GForce
Plugs: UAD•Slate•Scuffham•Flux IRCAM•NI Komplete•Klanghelm•Waves•Spectrasonics•Arturia•Soundtoys•Nomad Factory•PSP•Stillwell•Cytomic•Korg•Five12•GForce
- FMiguelez
- Posts: 8266
- Joined: Sun Oct 24, 2004 10:01 pm
- Primary DAW OS: MacOS
- Location: Body: Narco-México Soul/Heart: NYC
Re: Why are autosave files so much smaller?
I've always assumed the undo history is part of the autosaved DP file.
I've never noticed those files being any smaller than the original. I'll check how it is with mine when I fire up DP later today.
I've never noticed those files being any smaller than the original. I'll check how it is with mine when I fire up DP later today.
Mac Mini Server i7 2.66 GHs/16 GB RAM / OSX 10.14 / DP 9.52
Tascam DM-24, MOTU Track 16, all Spectrasonics' stuff,
Vienna Instruments SUPER PACKAGE, Waves Mercury, slaved iMac and Mac Minis running VEP 7, etc.
---------------------------
"In physics the truth is rarely perfectly clear, and that is certainly universally the case in human affairs. Hence, what is not surrounded by uncertainty cannot be the truth." ― Richard Feynman
Tascam DM-24, MOTU Track 16, all Spectrasonics' stuff,
Vienna Instruments SUPER PACKAGE, Waves Mercury, slaved iMac and Mac Minis running VEP 7, etc.
---------------------------
"In physics the truth is rarely perfectly clear, and that is certainly universally the case in human affairs. Hence, what is not surrounded by uncertainty cannot be the truth." ― Richard Feynman
- philbrown
- Posts: 2366
- Joined: Fri Nov 05, 2004 10:01 pm
- Primary DAW OS: MacOS
- Location: Almost Mexico
Re: Why are autosave files so much smaller?
I'm seeing now where even if I start a fresh file and work on it for a few hours the autosave file is always way smaller.
It's funny, I was looking at SSD drives to improve load times and such, and by setting aside older files and using the the much smaller autosave files my load times are WAY quicker with no hardware $$ needed.
It's funny, I was looking at SSD drives to improve load times and such, and by setting aside older files and using the the much smaller autosave files my load times are WAY quicker with no hardware $$ needed.
2020 iMac 27" 3.6GHz 10 core i9 • Mac OS 12.2.1 • DP 11.04 • UAD-8 Octo card • Midas M32R
Plugs: UAD•Slate•Scuffham•Flux IRCAM•NI Komplete•Klanghelm•Waves•Spectrasonics•Arturia•Soundtoys•Nomad Factory•PSP•Stillwell•Cytomic•Korg•Five12•GForce
Plugs: UAD•Slate•Scuffham•Flux IRCAM•NI Komplete•Klanghelm•Waves•Spectrasonics•Arturia•Soundtoys•Nomad Factory•PSP•Stillwell•Cytomic•Korg•Five12•GForce
- buzzsmith
- Posts: 3097
- Joined: Mon Dec 27, 2004 10:01 pm
- Primary DAW OS: MacOS
- Location: Houston
- Contact:
Re: Why are autosave files so much smaller?
Are you doing any audio, Phil, on your projects that the Autosave files are smaller?
Just guessing that the AS files may not actually include the audio and contain just pointers.
Dunno...I guess I'll have to go look for myself!
Buzzy
Just guessing that the AS files may not actually include the audio and contain just pointers.
Dunno...I guess I'll have to go look for myself!
Buzzy
Early 2009 Mac Pro 4,1>5,1 3.33 GHz Hex Core Intel Xeon OS X 10.8.5 SSD (32 gigs RAM)
DP 9.51 PCI-424e / original 2408, 2408mkII, 24I/O, MTP-AV
Yamaha C7 Conservatory Grand
Hammond B-3 / Leslie 145
Focal Twin6 Be(s)
DP 9.51 PCI-424e / original 2408, 2408mkII, 24I/O, MTP-AV
Yamaha C7 Conservatory Grand
Hammond B-3 / Leslie 145
Focal Twin6 Be(s)
- philbrown
- Posts: 2366
- Joined: Fri Nov 05, 2004 10:01 pm
- Primary DAW OS: MacOS
- Location: Almost Mexico
Re: Why are autosave files so much smaller?
Yes there are usually 3 hour long stereo files in the work I do, but when I trash the original and use the autosave file, there's nothing lost at all that I can see. The only difference is the load time is so much faster, and DP seems to be a little "snappier". The original DP can't contain all the audio info as the DP file would be gigabytes instead of MB's in this case.buzzsmith wrote:Are you doing any audio, Phil, on your projects that the Autosave files are smaller?
Just guessing that the AS files may not actually include the audio and contain just pointers.
Dunno...I guess I'll have to go look for myself!
Buzzy
2020 iMac 27" 3.6GHz 10 core i9 • Mac OS 12.2.1 • DP 11.04 • UAD-8 Octo card • Midas M32R
Plugs: UAD•Slate•Scuffham•Flux IRCAM•NI Komplete•Klanghelm•Waves•Spectrasonics•Arturia•Soundtoys•Nomad Factory•PSP•Stillwell•Cytomic•Korg•Five12•GForce
Plugs: UAD•Slate•Scuffham•Flux IRCAM•NI Komplete•Klanghelm•Waves•Spectrasonics•Arturia•Soundtoys•Nomad Factory•PSP•Stillwell•Cytomic•Korg•Five12•GForce
- buzzsmith
- Posts: 3097
- Joined: Mon Dec 27, 2004 10:01 pm
- Primary DAW OS: MacOS
- Location: Houston
- Contact:
Re: Why are autosave files so much smaller?
When you say "trash the original", you are disposing of the DP file, but not the audio folder within the project folder?philbrown wrote:Yes there are usually 3 hour long stereo files in the work I do, but when I trash the original and use the autosave file, there's nothing lost at all that I can see. The only difference is the load time is so much faster, and DP seems to be a little "snappier". The original DP can't contain all the audio info as the DP file would be gigabytes instead of MB's in this case.
So (maybe) the audio is still being pointed to by a DP Autosave file.
Now, I HAVE to go look for myself!
Buzzy
Early 2009 Mac Pro 4,1>5,1 3.33 GHz Hex Core Intel Xeon OS X 10.8.5 SSD (32 gigs RAM)
DP 9.51 PCI-424e / original 2408, 2408mkII, 24I/O, MTP-AV
Yamaha C7 Conservatory Grand
Hammond B-3 / Leslie 145
Focal Twin6 Be(s)
DP 9.51 PCI-424e / original 2408, 2408mkII, 24I/O, MTP-AV
Yamaha C7 Conservatory Grand
Hammond B-3 / Leslie 145
Focal Twin6 Be(s)
- philbrown
- Posts: 2366
- Joined: Fri Nov 05, 2004 10:01 pm
- Primary DAW OS: MacOS
- Location: Almost Mexico
Re: Why are autosave files so much smaller?
Yes to your questions, Buzzy. The DP folder is the same, I'm just taking the single original DP file itself, removing it from the folder, removing "autsosave" suffix from the autosave file (that's already in the folder) and using that in place of the original. Everything else, audio files, analysis files, etc unchanged. In my case, on different types of files, the autosave has ranged from 1/2 to 1/10 of the original file size.buzzsmith wrote:
When you say "trash the original", you are disposing of the DP file, but not the audio folder within the project folder?
So (maybe) the audio is still being pointed to by a DP Autosave file.
Buzzy
I'll do some more testing and observation when I have more non-work time. I just thought 1. someone might know more of what's going on here behind the scenes (maybe some Magic person) and 2. It seems to be a really easy way to trim file size, load/save time and I swear even bounces seem to be going noticeably faster. I haven't found a down side or anything missing so far. Obviously cover your butt and don't trash anything valuable or irreplaceable on my advice though!
2020 iMac 27" 3.6GHz 10 core i9 • Mac OS 12.2.1 • DP 11.04 • UAD-8 Octo card • Midas M32R
Plugs: UAD•Slate•Scuffham•Flux IRCAM•NI Komplete•Klanghelm•Waves•Spectrasonics•Arturia•Soundtoys•Nomad Factory•PSP•Stillwell•Cytomic•Korg•Five12•GForce
Plugs: UAD•Slate•Scuffham•Flux IRCAM•NI Komplete•Klanghelm•Waves•Spectrasonics•Arturia•Soundtoys•Nomad Factory•PSP•Stillwell•Cytomic•Korg•Five12•GForce
- MIDI Life Crisis
- Posts: 26254
- Joined: Wed May 18, 2005 10:01 pm
- Primary DAW OS: MacOS
- Contact:
Re: Why are autosave files so much smaller?
I'd like to know what's causing the original file to be bloated in the first place.
-
- Posts: 2188
- Joined: Thu Jan 13, 2005 10:01 pm
- Primary DAW OS: MacOS
- Location: USA
Re: Why are autosave files so much smaller?
My theory is, that the Autosave files have some kind of compression applied when they are made, to make them smaller on purpose.. It makes sense really, because one might build up hundreds of Autosaves, and that would eventually become wasteful of HD space. When you open an Autosave, it would expand back out (the compression would be lossless).
DP11, 2019 16-Core Mac Pro, Monterey, 64GB RAM. RME HDSPe MADI FX to SSL Alphalink to SSL Matrix console, and multiple digital sub consoles. UAD Quad PCIe. Outboard stuff.
- buzzsmith
- Posts: 3097
- Joined: Mon Dec 27, 2004 10:01 pm
- Primary DAW OS: MacOS
- Location: Houston
- Contact:
Re: Why are autosave files so much smaller?
Well, curiosity got the best of me so I checked a few...
(All are 22 Autosaves per song.)
Song 1: 5.5 MB - - - 1.75 GB in the Audio Folder
Autosaves: Most Recent: 496 KB...oldest (2 days ago) 1.7 MB
Song 2: 3.6 MB - - - 742 MB in the Audio Folder
Autosaves: Most recent: 2.7 MB...oldest (6 days ago) 2.7 MB
Song 3: 3.7 MB - - - 1.25 GB in the Audio Folder
Autosaves: Most recent: 393 KB...oldest (30 days ago) 664 KB
So, I'm not sure what this means other than to verify what Phil is seeing.
Buzzy
(All are 22 Autosaves per song.)
Song 1: 5.5 MB - - - 1.75 GB in the Audio Folder
Autosaves: Most Recent: 496 KB...oldest (2 days ago) 1.7 MB
Song 2: 3.6 MB - - - 742 MB in the Audio Folder
Autosaves: Most recent: 2.7 MB...oldest (6 days ago) 2.7 MB
Song 3: 3.7 MB - - - 1.25 GB in the Audio Folder
Autosaves: Most recent: 393 KB...oldest (30 days ago) 664 KB
So, I'm not sure what this means other than to verify what Phil is seeing.
Buzzy
Early 2009 Mac Pro 4,1>5,1 3.33 GHz Hex Core Intel Xeon OS X 10.8.5 SSD (32 gigs RAM)
DP 9.51 PCI-424e / original 2408, 2408mkII, 24I/O, MTP-AV
Yamaha C7 Conservatory Grand
Hammond B-3 / Leslie 145
Focal Twin6 Be(s)
DP 9.51 PCI-424e / original 2408, 2408mkII, 24I/O, MTP-AV
Yamaha C7 Conservatory Grand
Hammond B-3 / Leslie 145
Focal Twin6 Be(s)
- philbrown
- Posts: 2366
- Joined: Fri Nov 05, 2004 10:01 pm
- Primary DAW OS: MacOS
- Location: Almost Mexico
Re: Why are autosave files so much smaller?
Answer: UNDO HISTORY. That's the only difference I see.
A simple DP file: 16.1 MB
Same file.autosave: 254KB
Same autosave file re-saved with no changes except name change: 254KB
(eliminates some kind of autosave-specific compression, which I thought was extremely unlikely anyway).
The only difference I can find is Undo History - it's been emptied out in the autosave files.
If you save versions as you go like I do, you might consider changing Undo History prefs to save some unneeded file bloat.
A simple DP file: 16.1 MB
Same file.autosave: 254KB
Same autosave file re-saved with no changes except name change: 254KB
(eliminates some kind of autosave-specific compression, which I thought was extremely unlikely anyway).
The only difference I can find is Undo History - it's been emptied out in the autosave files.
If you save versions as you go like I do, you might consider changing Undo History prefs to save some unneeded file bloat.
2020 iMac 27" 3.6GHz 10 core i9 • Mac OS 12.2.1 • DP 11.04 • UAD-8 Octo card • Midas M32R
Plugs: UAD•Slate•Scuffham•Flux IRCAM•NI Komplete•Klanghelm•Waves•Spectrasonics•Arturia•Soundtoys•Nomad Factory•PSP•Stillwell•Cytomic•Korg•Five12•GForce
Plugs: UAD•Slate•Scuffham•Flux IRCAM•NI Komplete•Klanghelm•Waves•Spectrasonics•Arturia•Soundtoys•Nomad Factory•PSP•Stillwell•Cytomic•Korg•Five12•GForce
Re: Why are autosave files so much smaller?
I would have hoped autosave would relieve us of the need to constantly save versions of a project by including the undo history. If we still need to do that, autosave is pretty pointless.philbrown wrote:Answer: UNDO HISTORY. That's the only difference I see.
---
If you save versions as you go like I do, you might consider changing Undo History prefs to save some unneeded file bloat.
2018 Mini i7 32G 10.14.6, DP 11.3, Mixbus 9, Logic 10.5, Scarlett 18i8
- philbrown
- Posts: 2366
- Joined: Fri Nov 05, 2004 10:01 pm
- Primary DAW OS: MacOS
- Location: Almost Mexico
Re: Why are autosave files so much smaller?
It just depends on how you like to work and save things I think. I feel like I'm better informed about choices though and how to set my preferences accordingly. I personally am looking at autosave more as a failsafe if I have forgotten to save the last hour and DP folds up its tent (and that NEVER happens after I have just saved) so I haven't lost an hour of PITA editing or whatever. At least we know now that autosaves have no undo history, in case you were depending on the fact that it did.bayswater wrote:I would have hoped autosave would relieve us of the need to constantly save versions of a project by including the undo history. If we still need to do that, autosave is pretty pointless.philbrown wrote:Answer: UNDO HISTORY. That's the only difference I see.
---
If you save versions as you go like I do, you might consider changing Undo History prefs to save some unneeded file bloat.
2020 iMac 27" 3.6GHz 10 core i9 • Mac OS 12.2.1 • DP 11.04 • UAD-8 Octo card • Midas M32R
Plugs: UAD•Slate•Scuffham•Flux IRCAM•NI Komplete•Klanghelm•Waves•Spectrasonics•Arturia•Soundtoys•Nomad Factory•PSP•Stillwell•Cytomic•Korg•Five12•GForce
Plugs: UAD•Slate•Scuffham•Flux IRCAM•NI Komplete•Klanghelm•Waves•Spectrasonics•Arturia•Soundtoys•Nomad Factory•PSP•Stillwell•Cytomic•Korg•Five12•GForce
- FMiguelez
- Posts: 8266
- Joined: Sun Oct 24, 2004 10:01 pm
- Primary DAW OS: MacOS
- Location: Body: Narco-México Soul/Heart: NYC
Re: Why are autosave files so much smaller?
I just checked some DP files, and the regular file equals the corresponding autosaved file in size.
For instance, my empty template (no audio) currently is 24 MBs, just like the autosaved versions. If I dump the undo history, the file size still matches both version (regular and autosaved).
For instance, my empty template (no audio) currently is 24 MBs, just like the autosaved versions. If I dump the undo history, the file size still matches both version (regular and autosaved).
Mac Mini Server i7 2.66 GHs/16 GB RAM / OSX 10.14 / DP 9.52
Tascam DM-24, MOTU Track 16, all Spectrasonics' stuff,
Vienna Instruments SUPER PACKAGE, Waves Mercury, slaved iMac and Mac Minis running VEP 7, etc.
---------------------------
"In physics the truth is rarely perfectly clear, and that is certainly universally the case in human affairs. Hence, what is not surrounded by uncertainty cannot be the truth." ― Richard Feynman
Tascam DM-24, MOTU Track 16, all Spectrasonics' stuff,
Vienna Instruments SUPER PACKAGE, Waves Mercury, slaved iMac and Mac Minis running VEP 7, etc.
---------------------------
"In physics the truth is rarely perfectly clear, and that is certainly universally the case in human affairs. Hence, what is not surrounded by uncertainty cannot be the truth." ― Richard Feynman
- philbrown
- Posts: 2366
- Joined: Fri Nov 05, 2004 10:01 pm
- Primary DAW OS: MacOS
- Location: Almost Mexico
Re: Why are autosave files so much smaller?
Weird! Not at all what Buzzy and I are seeing. I haven't got a clue...FMiguelez wrote:I just checked some DP files, and the regular file equals the corresponding autosaved file in size.
For instance, my empty template (no audio) currently is 24 MBs, just like the autosaved versions. If I dump the undo history, the file size still matches both version (regular and autosaved).
2020 iMac 27" 3.6GHz 10 core i9 • Mac OS 12.2.1 • DP 11.04 • UAD-8 Octo card • Midas M32R
Plugs: UAD•Slate•Scuffham•Flux IRCAM•NI Komplete•Klanghelm•Waves•Spectrasonics•Arturia•Soundtoys•Nomad Factory•PSP•Stillwell•Cytomic•Korg•Five12•GForce
Plugs: UAD•Slate•Scuffham•Flux IRCAM•NI Komplete•Klanghelm•Waves•Spectrasonics•Arturia•Soundtoys•Nomad Factory•PSP•Stillwell•Cytomic•Korg•Five12•GForce