aboutsummaryrefslogtreecommitdiff
path: root/src/benchmark.py
Commit message (Collapse)AuthorAgeFilesLines
* add export to datarefFlorian Fischer2019-05-081-1/+27
|
* fix upper-whisker, singularize whisker names and capitalize csv headersFlorian Fischer2019-05-081-5/+5
|
* move list of available benchmarks to src.globalvars.benchmarksFlorian Fischer2019-04-291-1/+0
| | | | fix analyse
* fix Benchmark.runFlorian Fischer2019-04-281-1/+1
|
* use special allocator "malt" during analyse to run the benchmark only onceFlorian Fischer2019-04-281-6/+4
|
* don't fail if NaN is in evalFlorian Fischer2019-04-281-1/+7
|
* add standart deviation in percent of meanFlorian Fischer2019-04-151-0/+2
|
* improve descriptive statistics, csv-export and add general barplot functionFlorian Fischer2019-04-131-110/+198
|
* make tex tables standaloneFlorian Fischer2019-04-101-0/+3
|
* add normalization to plot_fixed_argFlorian Fischer2019-04-101-2/+10
|
* fix autoticks in plot_fixed_argFlorian Fischer2019-04-101-1/+1
|
* add analyze and server_benchmark featureFlorian Fischer2019-04-021-49/+61
| | | | | | | | | | | | | | | | | | | | | | --analyze uses malt to trace the benchmarks behavior. It uses the run loop but the obtained results are not stored Benchmark.server_benchmark is used if only a server is started for each allocator and clients are used to measure its performance in the run loop. If server_benchmark is set to True the cmds are run with the system default allocator. Misc changes: * The global environment is no longer changed. Instead a custom env dict is passed to suprocesses containing LD_PRELOAD. * Failing cmds no longer skip the whole benchmark instead they now skip the malfunctioning allocator. * Fix default title in plot_single_arg an analyse run are not stored
* move find_cmd to src/util.pyFlorian Fischer2019-04-021-24/+5
|
* add export_to_csv and use it in the loop benchmarkFlorian Fischer2019-03-251-1/+43
|
* fix plot_single_argFlorian Fischer2019-03-231-1/+1
|
* use numpy NaN for non numerical resultsFlorian Fischer2019-03-221-1/+4
|
* fix some ExceptionsFlorian Fischer2019-03-221-1/+1
|
* calculate mean and standard deviation for every data pointFlorian Fischer2019-03-221-42/+52
|
* alwys reset LD_PRELOAD even when a exception occursFlorian Fischer2019-03-221-0/+3
|
* use exceptions in mysql benchmarkFlorian Fischer2019-03-211-29/+16
|
* add scale arg to plot_single_argFlorian Fischer2019-03-191-4/+29
|
* fix run=0Florian Fischer2019-03-191-1/+1
|
* Don't print running if -r 0 is setFlorian Fischer2019-03-081-0/+5
|
* reset LD_PRELOAD after each allocatorFlorian Fischer2019-03-081-0/+7
|
* fix scale_threadsFlorian Fischer2019-03-061-1/+1
|
* improve thread scalingFlorian Fischer2019-03-061-8/+9
|
* add allocators to globalvars; kill mysql server on exit; save libc versions ↵Florian Fischer2019-03-061-3/+7
| | | | of requirements
* add function to scale thread to available cpusFlorian Fischer2019-03-051-0/+27
|
* add new verbosity and colored outputFlorian Fischer2019-03-051-31/+33
|
* fix perf checksFlorian Fischer2019-02-271-3/+7
|
* don't print output of test ls callFlorian Fischer2019-02-271-1/+2
|
* Revert "use global perf_allowed"Florian Fischer2019-02-221-5/+3
| | | | This reverts commit d6d502c22d7d0438b3151fd32d7eb6f83b73711f.
* use global perf_allowedFlorian Fischer2019-02-221-3/+5
|
* fix perf checkFlorian Fischer2019-02-221-2/+2
|
* add perf checkFlorian Fischer2019-02-221-0/+19
|
* be more verbose if requirement was not foundFlorian Fischer2019-02-221-0/+2
|
* change kwargs order to match order of call in bench.pyFlorian Fischer2019-02-151-1/+1
|
* don't use subprocess.check_output to support python3 < 3.7.0Florian Fischer2019-02-101-2/+4
|
* always use cmd_prefixFlorian Fischer2019-02-091-3/+11
|
* s/target/allocator/ and remove analyse featureFlorian Fischer2019-02-081-84/+30
| | | | Use systemwide installed allocators by default
* fix some flake8 linting errorsFlorian Fischer2019-02-021-45/+52
|
* rework build system #2: call make before executing any benchmarkFlorian Fischer2019-02-021-1/+5
| | | | | | Make scans the project directory for Makefiles and executes them. The targets should be build by the new targets/Makefile. All included Makefiles are now "quiet" by default.
* rework build system #1Florian Fischer2019-02-011-0/+2
| | | | | each benchmark has its own Makefile which must put it's binaries into OBJDIR which is added to the PATH during execution.
* add custom target optionFlorian Fischer2019-01-221-2/+2
| | | | | the custom target definitions must be a valid python script exporting a global dictionary "targets".
* add load path option and don't fail if result directories exists alreadyFlorian Fischer2019-01-221-1/+7
|
* remove debug output from write_best_doublearg_tex_tableFlorian Fischer2019-01-151-8/+0
|
* move benchmark to src dir and add autoticks option to plot functionsFlorian Fischer2019-01-151-0/+377