Chapter 1 Foreword

This is the online appendix for the paper “On the Assessment of Benchmark Suites for Algorithm Comparison”. It contains a commented and reproducible code for all the analysis, tables and plots presented in the paper and additional content.

The code used to generate this appendix is available at the repository: https://github.com/davidissamattos/evo-irt

1.1 Session info

This appendix is compiled automatically and the following session information was used to generate this appendix:

sessionInfo()
## R version 4.0.3 (2020-10-10)
## Platform: x86_64-apple-darwin17.0 (64-bit)
## Running under: macOS Big Sur 10.16
## 
## Matrix products: default
## BLAS:   /Library/Frameworks/R.framework/Versions/4.0/Resources/lib/libRblas.dylib
## LAPACK: /Library/Frameworks/R.framework/Versions/4.0/Resources/lib/libRlapack.dylib
## 
## locale:
## [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
## 
## attached base packages:
## [1] stats     graphics  grDevices utils     datasets  methods   base     
## 
## other attached packages:
##  [1] cmdstanr_0.3.0.9000 latex2exp_0.5.0     kableExtra_1.2.1   
##  [4] bayesplot_1.8.0     posterior_0.1.3     knitr_1.30         
##  [7] forcats_0.5.0       stringr_1.4.0       dplyr_1.0.2        
## [10] purrr_0.3.4         readr_1.3.1         tidyr_1.1.2        
## [13] tibble_3.0.4        ggplot2_3.3.3       tidyverse_1.3.0    
## 
## loaded via a namespace (and not attached):
##  [1] tidyselect_1.1.0  xfun_0.20         haven_2.3.1       colorspace_2.0-0 
##  [5] vctrs_0.3.6       generics_0.1.0    viridisLite_0.3.0 htmltools_0.5.1  
##  [9] yaml_2.2.1        blob_1.2.1        rlang_0.4.10      pillar_1.4.7     
## [13] glue_1.4.2        withr_2.3.0       DBI_1.1.0         dbplyr_1.4.4     
## [17] modelr_0.1.8      readxl_1.3.1      plyr_1.8.6        lifecycle_0.2.0  
## [21] munsell_0.5.0     gtable_0.3.0      cellranger_1.1.0  rvest_0.3.6      
## [25] evaluate_0.14     fansi_0.4.1       broom_0.7.0       Rcpp_1.0.5       
## [29] scales_1.1.1      backports_1.2.1   checkmate_2.0.0   webshot_0.5.2    
## [33] jsonlite_1.7.2    abind_1.4-5       fs_1.5.0          hms_0.5.3        
## [37] digest_0.6.27     stringi_1.5.3     bookdown_0.21     grid_4.0.3       
## [41] cli_2.2.0         tools_4.0.3       magrittr_2.0.1    crayon_1.3.4     
## [45] pkgconfig_2.0.3   ellipsis_0.3.1    xml2_1.3.2        ggridges_0.5.3   
## [49] reprex_0.3.0      lubridate_1.7.9   assertthat_0.2.1  rmarkdown_2.6    
## [53] httr_1.4.2        rstudioapi_0.13   R6_2.5.0          compiler_4.0.3