Online appendix for the paper: “On the Assessment of Benchmark Suites for Algorithm Comparison”
2021-04-15
Chapter 1 Foreword
This is the online appendix for the paper “On the Assessment of Benchmark Suites for Algorithm Comparison”. It contains a commented and reproducible code for all the analysis, tables and plots presented in the paper and additional content.
The code used to generate this appendix is available at the repository: https://github.com/davidissamattos/evo-irt
1.1 Session info
This appendix is compiled automatically and the following session information was used to generate this appendix:
sessionInfo()
## R version 4.0.3 (2020-10-10)
## Platform: x86_64-apple-darwin17.0 (64-bit)
## Running under: macOS Big Sur 10.16
##
## Matrix products: default
## BLAS: /Library/Frameworks/R.framework/Versions/4.0/Resources/lib/libRblas.dylib
## LAPACK: /Library/Frameworks/R.framework/Versions/4.0/Resources/lib/libRlapack.dylib
##
## locale:
## [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
##
## attached base packages:
## [1] stats graphics grDevices utils datasets methods base
##
## other attached packages:
## [1] cmdstanr_0.3.0.9000 latex2exp_0.5.0 kableExtra_1.2.1
## [4] bayesplot_1.8.0 posterior_0.1.3 knitr_1.30
## [7] forcats_0.5.0 stringr_1.4.0 dplyr_1.0.2
## [10] purrr_0.3.4 readr_1.3.1 tidyr_1.1.2
## [13] tibble_3.0.4 ggplot2_3.3.3 tidyverse_1.3.0
##
## loaded via a namespace (and not attached):
## [1] tidyselect_1.1.0 xfun_0.20 haven_2.3.1 colorspace_2.0-0
## [5] vctrs_0.3.6 generics_0.1.0 viridisLite_0.3.0 htmltools_0.5.1
## [9] yaml_2.2.1 blob_1.2.1 rlang_0.4.10 pillar_1.4.7
## [13] glue_1.4.2 withr_2.3.0 DBI_1.1.0 dbplyr_1.4.4
## [17] modelr_0.1.8 readxl_1.3.1 plyr_1.8.6 lifecycle_0.2.0
## [21] munsell_0.5.0 gtable_0.3.0 cellranger_1.1.0 rvest_0.3.6
## [25] evaluate_0.14 fansi_0.4.1 broom_0.7.0 Rcpp_1.0.5
## [29] scales_1.1.1 backports_1.2.1 checkmate_2.0.0 webshot_0.5.2
## [33] jsonlite_1.7.2 abind_1.4-5 fs_1.5.0 hms_0.5.3
## [37] digest_0.6.27 stringi_1.5.3 bookdown_0.21 grid_4.0.3
## [41] cli_2.2.0 tools_4.0.3 magrittr_2.0.1 crayon_1.3.4
## [45] pkgconfig_2.0.3 ellipsis_0.3.1 xml2_1.3.2 ggridges_0.5.3
## [49] reprex_0.3.0 lubridate_1.7.9 assertthat_0.2.1 rmarkdown_2.6
## [53] httr_1.4.2 rstudioapi_0.13 R6_2.5.0 compiler_4.0.3