Well, I believe that one thing we should do for obtaining meaningful easily comparable results is to use the same demo file as a kind of standard.
Any demo file should do, but personally I think that the one Michael is using is more suited to the job. He's doing frequent benchmarks with high coverage (you might want to compare with) and the file he's using can be easily found on the Dota 2 test profile: http://openbenchmarking.org/ [External Link] > Tests > Dota 2 > Revision history > latest release.
It is also the same file that Vulkan Source2 developers from Valve are recommending for testing, so it makes sense for me to use it as reference.

View this comment - View article - View full comments

It is indeed well done, a bit short mind you, but compared with a bunch of HL modifications I played it stands apart.

View this comment - View article - View full comments

Quoting: aFoxNamedMorrisOn a GTX 980 over here, I got capped at 120, with the occasional drop to 119.

Are you using the "+fps_max 0" argument?

View this comment - View article - View full comments

Quoting: liamdaweI wouldn't just use the ones the Valve dev pointed out, there aren't any that are the "best".

No, not the "best" indeed, they are just meant to illustrate scenarios where Vulkan is efficient.
Ideally I would use more demos with specific scenarios or a single one but much longer.
For the moment though is too early (I think) to spend so much time for a benchmark that tomorrow might be obsolete.

View this comment - View article - View full comments

Quoting: NyamiouThe resuls by dubigrasu already show that you can greatly change the results by using another demo

Yeah, but which one is the good one ? :)
Personally I used what dang_valve told me to use (after all, he's the damn Source Vulkan dev) for relevant Vulkan benchmarks, but I ran other demos too before that and the results were very different.
So not sure what to believe.

View this comment - View article - View full comments

Quoting: liamdaweThose are just what he happened to be testing with, doesn't mean the are the best. Just different.

Ah well (I misread your post), when Phoronix tested "some" random gameplay DanG said that they were not giving a full image of what Vulkan can do, so that's why he provided the ones I used.
From what I understood they are actually the best for this task, as in putting Vulkan to work.

View this comment - View article - View full comments

Quoting: Mountain ManBetween this and the OpenBenchmarking test, I'm beginning to the think the kid in this video screwed up his Linux benchmark.

Well, I don't know. Like I said, you get different results depending on what demo you use. Maybe I should've use the same demo he used for a strict/correct comparison?
But basically Valve's Dota dev said that those two demos (from Phoronix) are the ones to use when testing Vulkan...so I used one.

View this comment - View article - View full comments

Quoting: liamdaweThose are just what he happened to be testing with, doesn't mean the are the best. Just different.

Well yes, you're bound to get different results depending on what demo you use.
Even those from Dan give different results although they are both meant to prove Vulkan performance. The one that I used is the most spectacular (on my configuration) in performance gain (GL vs VK).

View this comment - View article - View full comments

Quoting: liamdaweSo you're using a different demo file to me then, I am using the same one the guy who did the video provided which is why I imagine my results are so different. The one in the video is much heavier.

Yeah, I'm using some demos provided by the Valve team/guy. I asked on Phoronix about some demos that he (Dan I think?) considers relevant for Vulkan and these are what he posted.

View this comment - View article - View full comments

There are two file demos included:"1971360796.dem" & "OctPerf.dem". I use the first one.

View this comment - View article - View full comments