Hacker News new | past | comments | ask | show | jobs | submit login

There are benchmarks, yes, but Anandtechs' bechmarks are mostly synthetic benches from systems almost no-one uses (I don't run SPEC benchmarks daily, and ok, I compile stuff, but not clang, nor using clang)

But Phoronix has synthetic benchmarks from systems quite a few people use (e.g. databases, rendering, simulation). SPEC is nice, but I wouldn't know where to look if I would want to apply that to e.g. postgres. With Phoronix' results, at least there is an idea of how I could apply the results of the benchmark to my usage.

So I find this link quite useful.

That's not to say that I think Anandtechs benchmarks are not valuable (I love reading the nitty gritty details like cache timing specifics), but I can't apply them to anything other than a generic CPU workload, not even slightly in the direction of my specific workload.




SPEC benchmarks are hardly synthetic. They're Perl programs like SpamAssassin, or GCC-compile times, and other "server-like" tasks.

So one can maybe argue that those workloads don't match your use case. But... SPECINT is the "standard server benchmark" for a reason.

I think there's been some suggestions that SPEC benchmarks are a bit small these days and maybe bigger code would be more realistic. But the actual programs they use are decent.


> SPEC benchmarks are hardly synthetic. They're Perl programs like SpamAssassin, or GCC-compile times, and other "server-like" tasks.

That I didn't know.

SPEC doesn't really do much in regards to giving descriptive names to benchmarked items, so its hard to determine what the numbers indicate (other than "this benchmark, which emulates some workload, now has X higher performance"). Some names are descriptive-ish (I think I recognise 7 out of 22 names) but it's all gibberish without a link to why those benchmarks are run and what they are based on (at least not in a way similar to how SPECjbb is explained). It might just be me failing to find it, but searching SPEC in the page (or their website) doesn't seem to give me relevant links.

Does Anandtech have a page detailing the rationale behind their current (CPU) benchmark suite?


https://www.spec.org/cpu2017/Docs/benchmarks/500.perlbench_r...

Among other benchmarks. But Perl is the first one in their suite.

EDIT: SPECjbb is the Java benchmark suite: https://www.spec.org/jbb2015/docs/designdocument.pdf

SPECjbb is a ~2 hour benchmark simulating a high-throughput Supermarket backend.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: