TEST: 5 DAWs 5 MBP Optical O/P You better read this :)

Discussion of Digital Performer use, optimization, tips and techniques on MacOS.

Moderator: James Steele

Forum rules
This forum is for most discussion related to the use and optimization of Digital Performer [MacOS] and plug-ins as well as tips and techniques. It is NOT for troubleshooting technical issues, complaints, feature requests, or "Comparative DAW 101."
User avatar
Gravity Jim
Posts: 2005
Joined: Wed Apr 30, 2008 2:55 am
Primary DAW OS: MacOS
Location: Santa Rosa, CA

Re: TEST: 5 DAWs 5 MBP Optical O/P You better read this :)

Post by Gravity Jim »

While recently shopping for a new digital console, I did some question-asking around the Web, including at Gearslutz. I had the Tascam DM3200 at the top of my list because its feature set fit my working style perfectly... but man, some of those guys really hate that board, either because it reminded them of some previous-gen Tascam console they hated or because it used the wrong veeblefezter in the potrzebie string or some other super-hyper-mega technical explanation of why it empirically has to suck.

So I did what any reasonable person would do when confronted with an outpouring of hatred at Gearslutz.

I bought the Tascam. :wink:
Jim Bordner

MacPro 5,1 (3.33Ghz 12-core), 32g RAM, OS X 10.14.6 • MOTU DP 10.11 • Logic Pro X 10.2.5 • Waves Platinum, UAD-2, Slate Digital, Komplete, Omnisphere 2, LASS, CineSamples, Chipsounds, V Collection 5[color]
User avatar
Radiogal
Posts: 1521
Joined: Tue Apr 29, 2008 12:42 pm
Primary DAW OS: MacOS
Location: Stockholm, Sweden
Contact:

Re: TEST: 5 DAWs 5 MBP Optical O/P You better read this :)

Post by Radiogal »

Larry Mal wrote:Sorry, Radiogal. There are a lot of problems with this "test" of yours, and I can't accept the results. I know I'm raining on the parade here.

But it's not scientific, which means it's only anecdotal. There's enough of that already regarding the "sound" of DAWs. I fight against that a lot on Gearslutz, and just because software that I enjoy has been said to "win" doesn't mean I can accept the answer.
Please!!!!This was not "my test". Mind you!
I´m just the messenger and sharing info about this event with you guys! As an engineer I found this intresting.

Man, why do they all keep picking on me?!!!!

Okay! PT 10 and Cubase came 2:nd. Happy now? It´s just how you put it.
DP was the most liked DAW. I believe I wrote that more often than ever using "win" or "won". Gaaah!
MAC PRO 6 Core 3.33 GHz, 16 GB RAM, OSX 10.8.5, DP 9 MAC and WIN (64bit/Jbridge) AMPGUI Mellow, Logic 10, Wavelab 8 MOTU 24I/O (x2), MOTU 2408 MK3 (2x), WAVES Mercury 9, SSL, UAD2Quad, McDSP, Sound Toys, Sonnox, Sonalksis, NomadFactory, T-Racks, P&M, LexPCM, AbbeyRoad, DSM, VCC, VTM, FGX, Melda, EWQL SymphOrch/Piano Gold. Mixingdesk: AMEK Big 44, TK BC-1MK2, SSLcomp clones, GAPPre73, PCM91, TC, FMR. Monitors: Genelec 1031, ADAM A7, >40 mics http://www.ragdollproduction.com
User avatar
MIDI Life Crisis
Posts: 26254
Joined: Wed May 18, 2005 10:01 pm
Primary DAW OS: MacOS
Contact:

TEST: 5 DAWs 5 MBP Optical O/P You better read this :)

Post by MIDI Life Crisis »

Dan Worley wrote:Thanks for getting DP included in the test, Radiogal. That was exciting!

Completely ignore the nastiness and idiocy that will be directed at you just for posting this.

c-ya,

Dan Worley
That's worth repeating here, Radiogal. You've got troops here, girl! The test is what it is. It may not be what some might want it to be to which I say 'Do your own test' and then we can talk. Otherwise the condemnations are just more noise than even the worst DAW might have. More like a skipping record.
2013 Mac Pro 32GB RAM

OSX 10.14.6; DP 10; Track 16; Finale 26, iPad Pro, et al

MIDI LIFE CRISIS
User avatar
Larry Mal
Posts: 353
Joined: Tue Dec 25, 2007 6:42 pm
Primary DAW OS: MacOS
Location: St. Louis, Missouri

Re: TEST: 5 DAWs 5 MBP Optical O/P You better read this :)

Post by Larry Mal »

It's not you! I like you, and I like Digital Performer!

It's just that unlike some of you, I do participate in Gearslutz... probably more than is mentally healthy. One of the main things I do on that site is to combat audio myths. Chief among those is the concept that different DAWs sound differently inherently.

You know. I've heard lately that Pro Tools is best for "rock and roll" for some reason. Now I'm hearing that Logic sounds "compressed". But no one can ever tell me why, exactly, this would be so.

I point out that nothing that happens in computer audio is nor can be an unknown factor. Computers simply process information in a predictable way based on how they are told to process it. If Logic sounds "compressed", that's because someone made it to be compressed, which they didn't, or they screwed up very badly, since the output of Logic is not the sum we would expect it to be.

The chief problem I have with this test is not that it's a blind listening test in an uncontrolled environment, but mainly that it was done with a group of people. That has been shown time and time again to skew results.

For instance, if I am the first one in the group to say that, "The first computer sounds better. The third computer sounds more compressed," then there is a slight pressure for anyone who follows to agree with me. We all like to think we are independent thinkers who can make decisions based on what is right and wrong, but this is completely false. It's natural for human beings to conform to the standards of their group, and it's natural for groups of humans to develop leaders who are perceived as setting those standards to a large degree.

And if there emerges a majority that agrees that one computer sounds better, there will be a tendency for folks to go along with that majority. All of them? No. Some will try and analyze and come to an independent conclusion. But it will be enough to make any results suspect.

In the same way, I pointed out on Gearslutz, I could assemble people in a group and tell them that I wanted to find out which of two colas they preferred to drink. I could pour the exact same sodas and claim that they are different, and over time it will emerge that the group prefers the taste of one over the other. It will likely not be 50/50, and they will not perceive the colas as being the same. Even if they don't actually speak to each other about which they prefer, there is a whole range of other ways that human beings communicate preference that will be going on.

And that is why I am suspect of this test. It might have been double blind, but there was an entire other set of biases introduced here that render any results moot in my eyes.

Again, I know you didn't do the test and I have nothing but respect and admiration for you, I just can't be silent about my skepticism of the results.
Mac Pro 2X2.8 GHz 8 Core, Macbook Pro 2.16 GHz Core 2 Duo, 2 GB's of RAM. Logic Pro 8. Digital Performer 5.13. Pro Tools M-Powered 7.4. Ableton Live 5. Focusrite Sapphire Pro 10 I/O interface.
User avatar
FMiguelez
Posts: 8266
Joined: Sun Oct 24, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Body: Narco-México Soul/Heart: NYC

Re: TEST: 5 DAWs 5 MBP Optical O/P You better read this :)

Post by FMiguelez »

MIDI Life Crisis wrote: That's worth repeating here, Radiogal. You've got troops here, girl!
+1000.

People always want to shoot the messenger... :shake:

Actually, I'm not disappointed of the GS crowd. They are acting like they always do. What else could we possibly expect from them??? :roll:

The point is that the test RG talks about is burning a hole in some of them. Like we say here, they are hearing steps on their roofs (it that makes any sense - meaning their usual paradigms have been challenged and rocked, and not for good :lol: ). I guess that pisses them off? :lol:
Mac Mini Server i7 2.66 GHs/16 GB RAM / OSX 10.14 / DP 9.52
Tascam DM-24, MOTU Track 16, all Spectrasonics' stuff,
Vienna Instruments SUPER PACKAGE, Waves Mercury, slaved iMac and Mac Minis running VEP 7, etc.

---------------------------

"In physics the truth is rarely perfectly clear, and that is certainly universally the case in human affairs. Hence, what is not surrounded by uncertainty cannot be the truth." ― Richard Feynman
User avatar
FMiguelez
Posts: 8266
Joined: Sun Oct 24, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Body: Narco-México Soul/Heart: NYC

Re: TEST: 5 DAWs 5 MBP Optical O/P You better read this :)

Post by FMiguelez »

Larry Mal wrote: For instance, if I am the first one in the group to say that, "The first computer sounds better. The third computer sounds more compressed," then there is a slight pressure for anyone who follows to agree with me. We all like to think we are independent thinkers who can make decisions based on what is right and wrong, but this is completely false. It's natural for human beings to conform to the standards of their group, and it's natural for groups of humans to develop leaders who are perceived as setting those standards to a large degree.
Maybe so.
But these people were not the usual cows or sheep who blindly follow anything. They were professional engineers with strong egos and opinions...

I doubt any of them would be "afraid" of disagreeing with another one.

The test just shows they preferred the sound of one DAW over the others over a period of multiple takes and 2.5 hours. And it was not by a slight margin either...

We don't actually know the algorithms any DAW uses to sum stuff. Perhaps the difference is there?
Also, if Logic had "won", would there be the same reactions over there?

If you could describe the IDEAL/ULTIMATE DAW listening test, what would it be like exactly?
Would it be even possible to do a truly scientific listening test taking into account that sound/music are totally subjective?
Mac Mini Server i7 2.66 GHs/16 GB RAM / OSX 10.14 / DP 9.52
Tascam DM-24, MOTU Track 16, all Spectrasonics' stuff,
Vienna Instruments SUPER PACKAGE, Waves Mercury, slaved iMac and Mac Minis running VEP 7, etc.

---------------------------

"In physics the truth is rarely perfectly clear, and that is certainly universally the case in human affairs. Hence, what is not surrounded by uncertainty cannot be the truth." ― Richard Feynman
User avatar
Radiogal
Posts: 1521
Joined: Tue Apr 29, 2008 12:42 pm
Primary DAW OS: MacOS
Location: Stockholm, Sweden
Contact:

Re: TEST: 5 DAWs 5 MBP Optical O/P You better read this :)

Post by Radiogal »

Imagine this:
5 DAWs 5 MBP Optical O/P

"Hurray PT 10 was the most liked DAW!! 30+ audio pro engineers. Man! That many?? So cool!!! PT10 Sounded the fullest deepest and most complete. Hurray hurray!!! Fanfare!!! Yeah buddy! I´ve been using PT since I was born. You too.. ?? Love this DAW. Love you guys. We´re rocking!!! Let´s spread the news about this! Let´s tell the world!!! Let´s post on GS......"


What really happens right now on GS:
"Whut? No, really... DP ... are you kidding??? Oh No!!!! That´s not.. eh..true.. eh? No the test must be wrong. All DAW sound the same! Must be something wrong with the set up!!! Those stupid swedes must be totally nuts. All must be deaph so called engineers and audio slaves following their leaders, MOTU dictators probably.
Man, all swedish music sounds crap. DP??? This just can´t be true...!! Must check RG post on GS.. See!!! She writes about DP in other posts too!!! Man, she´s to DP friendly. No wonder!!! Stupid girl to post this BS. Knows nothing about anything about what GS is all about"..."
MAC PRO 6 Core 3.33 GHz, 16 GB RAM, OSX 10.8.5, DP 9 MAC and WIN (64bit/Jbridge) AMPGUI Mellow, Logic 10, Wavelab 8 MOTU 24I/O (x2), MOTU 2408 MK3 (2x), WAVES Mercury 9, SSL, UAD2Quad, McDSP, Sound Toys, Sonnox, Sonalksis, NomadFactory, T-Racks, P&M, LexPCM, AbbeyRoad, DSM, VCC, VTM, FGX, Melda, EWQL SymphOrch/Piano Gold. Mixingdesk: AMEK Big 44, TK BC-1MK2, SSLcomp clones, GAPPre73, PCM91, TC, FMR. Monitors: Genelec 1031, ADAM A7, >40 mics http://www.ragdollproduction.com
User avatar
Larry Mal
Posts: 353
Joined: Tue Dec 25, 2007 6:42 pm
Primary DAW OS: MacOS
Location: St. Louis, Missouri

Re: TEST: 5 DAWs 5 MBP Optical O/P You better read this :)

Post by Larry Mal »

FMiguelez wrote: Maybe so.
But these people were not the usual cows or sheep who blindly follow anything. They were professional engineers with strong egos and opinions...

I doubt any of them would be "afraid" of disagreeing with another one.

The test just shows they preferred the sound of one DAW over the others over a period of multiple takes and 2.5 hours. And it was not by a slight margin either...

We don't actually know the algorithms any DAW uses to sum stuff. Perhaps the difference is there?
Also, if Logic had "won", would there be the same reactions over there?

If you could describe the IDEAL/ULTIMATE DAW listening test, what would it be like exactly?
Would it be even possible to do a truly scientific listening test taking into account that sound/music are totally subjective?
Yeah, you would think that, but perception bias (among other biases that are introduced during testing) is a human phenomenon and thus affects everyone. It's tempting to think that people of a certain education or experience or anything else are able to think more clearly, but it's not true.

You could have done the test with the same software and gotten a favorite. And like I say, I am not surprised to hear that it was not a close call in favor of laptop #1. That simply tells me that group think was very strong and that is what I would expect.

It would be very hard to do a completely scientific listening test, which is why it rarely happens. How would I set up such a test? Well, I would have to spend a lot of time thinking about that which I am not really willing to do since I'm not going to do such a test. When I get paid to do that test, then I'll decline because I am not qualified to do such a test anyway, and I would at a minimum have to do a lot of learning in order to conduct scientific testing. Not everyone can do that, you know... it's a job and a skill. You know, the same as not everyone can do your job, even though a lot of people probably think they can and have some of the equipment and knowledge to do it?

Personally, though, I place more stock in measurements. Again, it's computer audio, predictable and measurable. And testable. If I want to know what the output of a DAW is compared to the output of another DAW with the same settings, then I measure the results. I have more stock in that than I do with using ears, whether they be mine or other's.
Mac Pro 2X2.8 GHz 8 Core, Macbook Pro 2.16 GHz Core 2 Duo, 2 GB's of RAM. Logic Pro 8. Digital Performer 5.13. Pro Tools M-Powered 7.4. Ableton Live 5. Focusrite Sapphire Pro 10 I/O interface.
User avatar
FMiguelez
Posts: 8266
Joined: Sun Oct 24, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Body: Narco-México Soul/Heart: NYC

Re: TEST: 5 DAWs 5 MBP Optical O/P You better read this :)

Post by FMiguelez »

Radiogal wrote:Imagine this:
5 DAWs 5 MBP Optical O/P

"Hurray PT 10 was the most liked DAW!! 30+ audio pro engineers. Man! That many?? So cool!!! PT10 Sounded the fullest deepest and most complete. Hurray hurray!!! Fanfare!!! Yeah buddy! I´ve been using PT since I was born. You too.. ?? Love this DAW. Love you guys. We´re rocking!!! Let´s spread the news about this! Let´s tell the world!!! Let´s post on GS......"


What really happens right now on GS:
"Whut? No, really... DP ... are you kidding??? Oh No!!!! That´s not.. eh..true.. eh? No the test must be wrong. All DAW sound the same! Must be something wrong with the set up!!! Those stupid swedes must be totally nuts. All must be deaph so called engineers and audio slaves following their leaders, MOTU dictators probably.
Man, all swedish music sounds crap. DP??? This just can´t be true...!! Must check RG post on GS.. See!!! She writes about DP in other posts too!!! Man, she´s to DP friendly. No wonder!!! Stupid girl to post this BS. Knows nothing about anything about what GS is all about"..."
:lol:

Frankly, it's sad, but you are SO RIGHT! That's exactly what would've happened in your first scenario.
Even sadder, the second one is what is happening right now... they must be even questioning Swedes' taste, music and skills :shake:

Perhaps MOTU's CEO is Swedish too?

Had we done this same test in Mexico, we would've been accused of bribing the audience... and they would probably be right! :mrgreen:

:lol:
Mac Mini Server i7 2.66 GHs/16 GB RAM / OSX 10.14 / DP 9.52
Tascam DM-24, MOTU Track 16, all Spectrasonics' stuff,
Vienna Instruments SUPER PACKAGE, Waves Mercury, slaved iMac and Mac Minis running VEP 7, etc.

---------------------------

"In physics the truth is rarely perfectly clear, and that is certainly universally the case in human affairs. Hence, what is not surrounded by uncertainty cannot be the truth." ― Richard Feynman
User avatar
cbergm7210
Posts: 1671
Joined: Mon Jan 14, 2008 10:34 am
Primary DAW OS: MacOS
Location: High Ridge, MO

Re: TEST: 5 DAWs 5 MBP Optical O/P You better read this :)

Post by cbergm7210 »

Had we done this same test in Mexico, we would've been accused of bribing the audience :mrgreen:
You rock, FM. :lol:
Mac Pro 2.66GHz Dual Quad Core Nahalem, 16 Gigs RAM, DP 9, RME Fireface 800, MOTU MIDIexpress 128, Mac OS 10.8.5

http://www.rfjmusic.com
User avatar
MIDI Life Crisis
Posts: 26254
Joined: Wed May 18, 2005 10:01 pm
Primary DAW OS: MacOS
Contact:

Re: TEST: 5 DAWs 5 MBP Optical O/P You better read this :)

Post by MIDI Life Crisis »

Well again, it is what it is. It was a taste test and there is no quantifying a taste test. There are empirical methods of conducting the test but no conclusion can be drawn - except what the majority of people liked and didn't like. What may be irking the GS folks is that they can't tip the scales as there is no poll involved.

Not just a funny picture, but an interesting and perhaps relevant article... just click on the picture... if you do, be sure to at least scroll down to the picture of the guys holding their noses! Too funny and I do believe some of those guys may be the ones who are posting on GS... LOL!

Image
2013 Mac Pro 32GB RAM

OSX 10.14.6; DP 10; Track 16; Finale 26, iPad Pro, et al

MIDI LIFE CRISIS
User avatar
jloeb
Posts: 897
Joined: Tue Oct 26, 2004 10:01 pm
Primary DAW OS: MacOS
Location: Philly

Re: TEST: 5 DAWs 5 MBP Optical O/P You better read this :)

Post by jloeb »

MIDI Life Crisis wrote:What may be irking the GS folks is that they can't tip the scales as there is no poll involved.
LOL.

"REAPER! It's Reaper that sounds the best!!! REAPER!!"
User avatar
mikehalloran
Posts: 15133
Joined: Sun Jan 25, 2009 5:08 pm
Primary DAW OS: MacOS
Location: Sillie Con Valley

Re: TEST: 5 DAWs 5 MBP Optical O/P You better read this :)

Post by mikehalloran »

I think the most telling fact - and the one that cannot be denied is this: DP wasn't worse than the others.

We are often criticized by users of other products, especially PT and occasionally Logic, for using something that isn't up to their level professionally - whatever that really means beyond personal bias (no, I'm not talking about BIAS). This seems to be most rife in the world of film scoring and production where some still can't accept that mag film and Tascam Digital-8 are dead.

Can you imagine the vitriol if, instead of DP, it was GarageBand, R_____ or Audacity that came out on top? In thit particular test, it could have happened but didn't as none are considered professional tools - and rightly so as they aren't.

Yes, a more comprehensive test involving VIs and plugins would be nice. Perhaps, someday, someone will do it. This one, however, is what it is and DP stands on its merits: Excellent sound that doesn't take a back seat to anything else out there.

Congrats, RG, for a job well done!
DP 11.31; 828mkII FW, micro lite, M4, MTP/AV USB Firmware 2.0.1
2023 Mac Studio M2 8TB, 192GB RAM, OS Sonoma 14.4, USB4 8TB external, M-Audio AIR 192|14, Mackie ProFxv3 6/10/12; 2012 MBPs Catalina, Mojave
IK-NI-Izotope-PSP-Garritan-Antares, LogicPro X, Finale 27.4, Dorico 5.2, Notion 6, Overture 5, TwistedWave, DSP-Q 5, SmartScore64 Pro, Toast 20 Pro
User avatar
Larry Mal
Posts: 353
Joined: Tue Dec 25, 2007 6:42 pm
Primary DAW OS: MacOS
Location: St. Louis, Missouri

Re: TEST: 5 DAWs 5 MBP Optical O/P You better read this :)

Post by Larry Mal »

Right, but persuading one's self that Digital Performer sounds better based on this test only makes you the same as all the myopic people you complain about on Gearslutz, only myopic about different software.

That's what I'm trying to tell folks. Don't like the Gearslutz Pro Tools bullies and their attitude towards Digital Performer, based on nothing except opinion? Don't become them in the opposite direction. That's why this site is better in a lot of ways to that one, because it has a more knowledgeable user base over all. I'm surprised to be reading this here.
Mac Pro 2X2.8 GHz 8 Core, Macbook Pro 2.16 GHz Core 2 Duo, 2 GB's of RAM. Logic Pro 8. Digital Performer 5.13. Pro Tools M-Powered 7.4. Ableton Live 5. Focusrite Sapphire Pro 10 I/O interface.
User avatar
MIDI Life Crisis
Posts: 26254
Joined: Wed May 18, 2005 10:01 pm
Primary DAW OS: MacOS
Contact:

Re: TEST: 5 DAWs 5 MBP Optical O/P You better read this :)

Post by MIDI Life Crisis »

jloeb wrote:
MIDI Life Crisis wrote:What may be irking the GS folks is that they can't tip the scales as there is no poll involved.
LOL.

"R•••••! It's R••••• that sounds the best!!! R•••••!!"
That's just grim!
2013 Mac Pro 32GB RAM

OSX 10.14.6; DP 10; Track 16; Finale 26, iPad Pro, et al

MIDI LIFE CRISIS
Post Reply