Is performance improved on Linux?

View this comment - View article - View full comments

I regularly play PZ with my friends. I can absolutely recommend the multiplayer, it really is a ton of fun. I think it is the only early access title that I actually play

View this comment - View article - View full comments

Love the game, but performance has be always crappy for me, as soon as the city becomes large. I don't think that the devs are going to try and improve it on Linux; I blame it on Unity engine! That said, with new content I might pick it up again

View this comment - View article - View full comments

I got Windwards, but I got bored very soon. The only things to do, apparently, were going from point A to point B and battling some ships. Did I miss something there? This one looks prettier, but only naval battles might be not enough content.

View this comment - View article - View full comments

Most likely, is gonna be worth a full price purchase, but, as much as I loved XCOM:EU and EW, I will stay strong and *not* pre-order this.

View this comment - View article - View full comments

Quoting: CAPTNCAPSHmm, not all steam linux games are on there :/
Missing for example Slime Rancher, which is currently early access, would've liked to upload a Benchmark of it.
Anyway, registered, submitted 4 benchmarks :)

Hmm, interesting. I get the updated list of games from steamdb: https://github.com/SteamDatabase/SteamLinux/blob/master/GAMES.json [External Link]
I think that Early Access games are not there. Now it would be good to know if the community is interested in having support for those....

View this comment - View article - View full comments

Quoting: Commander

Quoting: JSalem...stuff....

For example say you got ~50+ people uploading benchmarks of CS:GO. Some of them are Linux users and some of them are Windows users. You group those people up in their own "camps" and accumulate their results together. This I think will give a better "general" result as the benchmarks grow in numbers overtime. (Still wont be as exact as having identical cases but from a user point of view I think it can be interesting).

Ofc then you could click on said benchmarks see all uploads that attribute to the final "score", same comparisons could be then done say Nvidia vs AMD, or even Nvidia 361 vs Nvidia 358 driver versions etc. To make the score better you could then remove extreme values etc. Allot to play with here =)

With the current setup in opengamebenchmarks, it is possible at any point to aggregate the data, for example, of a certain game and do the two groups Linux and Windows (or even separating linux distros, etc.). But computing a single "score" for each group is very very tricky, and potentially misleading. The main problem is that you need to asses if the variation among the groups is bigger or smaller than the variation between the groups, so you need something like ANOVA (https://en.wikipedia.org/wiki/Analysis_of_variance [External Link]). And, in turn, those variances could be very inaccurate, if the sample size is too small, and there could be a number of hidden factors... So it is better, at the beginning, to just collect the data.

Quoting: CommanderIf you need any help im happy to contribute =) Also some games do come with demo files (source based games) that users could upload for other people to compare.

Thank you! I'll put the code on github soon, and I will most definitely need some help!

View this comment - View article - View full comments

Quoting: Half-Shot

Quoting: Doc AngeloI'm kinda curious how it will turn out, that these will be benchmarks of random scenery or level of a game. Someone could benchmark looking 5 minutes at the sky box at lowest settings. Someone else could upload a benchmark result of 5 minutes in a complex level with highest settings in 4k resolution. If there will only be 1 single average value, it will be pointless. But it's a young project, we'll see where it will go.

This.

I'm not sure I follow the purpose of the site at all. I'm all for a benchmark consolidation site where we all throw scores of our tests at but there are quire a few problems.

I can't run other peoples tests, so I can't compare against them. Allowing users to run their own tests at all seems dangerous, since the scores vary wildly depending on what your doing in game/test. Finally, I've noticed the only way to disginguish users is by hardware, driver (though NOT version), and distro (again, not version). So I could run Mesa on Ubuntu Warty Warthog and then try to compare against a seemingly same user running Ubuntu Utopic Unicon and obviously the results would be absolutely massivly different.

The concept is cool, but I can't see how the implementation is useful.

If this seems like a rant, it's meant to be constructive critisizm. As someone who has been doing Mesa benchmarks for two years, I want to have tools that can reproduce results correctly.

Thanks for the fedback, I see where are you coming from.
As you know, having standardized tests is hard, if possible at all in this case, where the vast majority of games do not have a benchmark tool. One way could be having a set of hardware various enough, and doing all the tests in a controlled environment. The other way is letting the community accumulate data (surely noisy and less controlled) to a centralized place, and then try to make some sense of it: filtering, aggregating, normalizing, visualizing.

The idea here is I, random_linux_user_37, want to buy game X, and I want to know how with my settings (cpu, gpu, resolution) that game would run.
Another thing that I hope the site will provide is some sort of comparison grounds with Windows. Hopefully, with the accumulation of enough data, and possibly the development of automating tools (that for example can run a certain game at certain settings, certain stage, and then upload everything), we will have a solid ground to make informed decisions and try to push developers and porters to focus on better performance on Linux.

Finally, I could add even more fields like driver version and Linux distro; but on one hand I am a bit skeptical that that would be really that big of a difference (given same hardware and driver) between two Ubuntu versions (as in your example), and on the other hand adding variables can possibly complicate even more an already noisy situation.

If there will only be 1 single average value, it will be pointless.

That should not be the case; each benchmark is stored with all of its data, and several statistical measures are computed. And then you can compare benchmarks, selecting which one do you want to see (ex. "let's see how game X performs on open source and proprietary drivers")

View this comment - View article - View full comments

Hey, OpenGameBenchmarks dev here! I am looking forward to make this little project of mine grow and mature with the help of the community. Let's bring gaming on Linux to new heights!

View this comment - View article - View full comments