aboutsummaryrefslogtreecommitdiff
path: root/src/benchmark.py
Commit message (Collapse)AuthorAgeFilesLines
* add option to parse measure cmd stdout as csvFlorian Fischer2019-12-041-1/+2
|
* support tikz plot using tikzplotlibFlorian Fischer2019-11-281-4/+19
|
* fix scale factor > 0 for systems with more than 10 cpusFlorian Fischer2019-11-281-2/+2
|
* allow scale factors < 1Florian Fischer2019-11-271-1/+1
|
* fix Benchmark and facter load functionsFlorian Fischer2019-11-231-3/+3
|
* change result format from pickle to jsonFlorian Fischer2019-11-231-14/+31
|
* make plot_* functions more robust to missing valuesFlorian Fischer2019-11-221-12/+20
|
* fix some format hintsFlorian Fischer2019-11-221-9/+9
|
* extract perf check from way too long run methodFlorian Fischer2019-11-221-17/+23
|
* don't skip earlyFlorian Fischer2019-11-061-1/+0
|
* fix invalid except syntaxFlorian Fischer2019-11-061-1/+1
|
* skip not starting serversFlorian Fischer2019-11-061-3/+17
|
* remove debug output from benchmark.pyFlorian Fischer2019-11-061-1/+0
|
* use booktabs in standalone tex tablesFlorian Fischer2019-10-301-0/+1
| | | | \toprule is definied in booktabs
* add toprule to tex tablesFlorian Fischer2019-10-301-0/+1
|
* add and use write_tex_table functionFlorian Fischer2019-10-301-0/+101
|
* introduce a global summary file extensionFlorian Fischer2019-10-301-3/+3
|
* improve scale_thread_for_cpusFlorian Fischer2019-10-211-21/+21
| | | | | | | Thread numbers are now a factor of two. Allow creation of Benchmark objects when src.globalvars.result_dir is not set.
* don't try to terminate servers that exited with 0Florian Fischer2019-10-131-1/+1
|
* support substitutions in server shutdown_cmdsFlorian Fischer2019-10-131-6/+10
|
* catch SIGSEGV as well; register sa_handlers only if its SIG_DLF beforeFlorian Fischer2019-09-291-7/+2
|
* catch if cmd abortsFlorian Fischer2019-09-291-1/+7
| | | | | | perf stat does not propagate if the measured cmd aborts. To solve thing in a universal way we register a SIGABRT handler which creates the file aborted
* add perm substitution for benchmarks with empty argsFlorian Fischer2019-09-191-0/+2
|
* add raxml-ng benchmarkFlorian Fischer2019-09-141-3/+3
|
* explicitly collect binary versionsFlorian Fischer2019-09-111-1/+0
| | | | | | | There is no generic way to retrieve the version of a binary. Not everyone followes GNU cli guidelines and supports "--version". The larson benchmark for example reads input from stdin when started with "larson --version" blocking the Benchmark.prepare() call.
* fix wrong use of benchmark.results["facts"]Florian Fischer2019-09-111-1/+1
|
* add build_dir member to Benchmark objectsFlorian Fischer2019-09-111-0/+4
|
* improve server benchmarksFlorian Fischer2019-09-111-20/+55
| | | | | | | servers are now dictionary with two mandatory keys: "name" and "cmd". Optional keys are: * "prepare_cmds": commands are run after a server is started * "shutdown_cmds": commands are run before a server is terminated
* add runs to benchmark factsFlorian Fischer2019-09-111-0/+2
|
* fix barplot for benchmarks with empty args dictFlorian Fischer2019-09-041-3/+9
|
* rework Benchmark.terminate_subprocess to use Popen.communicateFlorian Fischer2019-09-041-10/+12
| | | | code is inspired by the example in the python3 subprocess documentation
* try to get version of benchmark requirementsFlorian Fischer2019-08-301-1/+3
|
* improve benchmark code qualityFlorian Fischer2019-08-291-11/+17
|
* require a name in Benchmark.__init__Florian Fischer2019-08-291-15/+16
|
* remove verbosity argument from hooksFlorian Fischer2019-08-271-9/+3
|
* set Benchmark.result_dir in Benchmark.__init__Florian Fischer2019-08-261-0/+6
|
* add error bars to barplot_single_argFlorian Fischer2019-08-261-2/+9
|
* only call shutdown_servers if there are serversFlorian Fischer2019-08-241-1/+2
|
* add benchmark members to available substitutionsFlorian Fischer2019-08-221-0/+2
|
* remove duplicate check if we really should run the benchmarkFlorian Fischer2019-08-221-4/+1
|
* stop saving or calculating stats of allocators without measurementsFlorian Fischer2019-08-221-3/+11
|
* remove old not used statistic fields from results dictionaryFlorian Fischer2019-08-221-2/+0
|
* Merge branch 'lld'Florian Fischer2019-08-201-12/+25
|\
| * add lld benchmark using lld provided benchmarkslldFlorian Fischer2019-08-201-13/+26
| | | | | | | | | | | | | | Benchmark changes the current working directory if self.run_dir is set befor each benchmark run. lld does not work with print_status_on_exit.so so reading and removing status is no only done if a status file is available.
* | fix benchmarks without measure commandFlorian Fischer2019-08-201-4/+6
|/
* let the loader load the benchmark not execFlorian Fischer2019-08-121-1/+2
| | | | | If the loader calls build/exec the execvp from build/exec is handled by the system loader.
* fix benchmarks for any glibc versionFlorian Fischer2019-08-121-1/+1
| | | | | | | | | use the included loader of the build glibc instead of LD_LIBRARY_PATH. Using LD_LIBRARY_PATH probably fails because of incompatible system loaders and newer glibc versions. Then we have to reverse the positions of {measure cmd} and {cmd prefix} in the exec chain because ld loads only ELF binaries and {measure cmd} could be a script.
* use absolut path of benchmark binaryFlorian Fischer2019-08-121-1/+2
|
* use LD_LIBRARY_PATH for glibc instead of calling its loaderFlorian Fischer2019-08-121-1/+7
| | | | | | | | Calling the loader fails on non ELF executables. Exec, formerly run_cmd, now takes two options: -l LD_LIBRARY_PATH, -p LD_PRELOAD. -p sets LD_PRELOAD and -l LD_LIBRARY_PATH before executing the rest of argv. glibc no longer uses cmd_prefix in favor of LD_LIBRARY_PATH.
* Rework exec chainFlorian Fischer2019-08-111-18/+17
| | | | | | | | | | | | | | Originally the structure of the executed cmd was {measure cmd} {allocator cmd prefix} {cmd} with the parent environment except LD_PRELOAD was modified for the whole command chain. Unfortunatly perf causes segfaults with some allocators and measuring allocators cmd prefixes doesnt seem fair. So the new cmd chain looks like: {allocator cmd prefix} {measure cmd} run_cmd <LD_PRELOAD> {cmd} without touching the environment in python. run_cmd sets LD_PRELOAD to the value it received in argv[1] and executes argv[2] with the rest of argv. This does also measure code not part of the actual benchmark but in a equal manner and not only for some allocators.
generated by cgit v1.2.3 (git 2.25.1) at 2026-04-25 14:06:04 +0000