Last updated on 2025-06-18 19:49:45 CEST.
| Flavor | Version | Tinstall | Tcheck | Ttotal | Status | Flags |
|---|---|---|---|---|---|---|
| r-devel-linux-x86_64-debian-clang | 0.3.2 | 15.98 | 330.18 | 346.16 | ERROR | |
| r-devel-linux-x86_64-debian-gcc | 0.3.2 | 9.10 | 221.39 | 230.49 | ERROR | |
| r-devel-linux-x86_64-fedora-clang | 0.3.2 | 292.20 | ERROR | |||
| r-devel-linux-x86_64-fedora-gcc | 0.3.2 | 295.78 | ERROR | |||
| r-devel-windows-x86_64 | 0.3.2 | 15.00 | 276.00 | 291.00 | NOTE | |
| r-patched-linux-x86_64 | 0.3.2 | 13.22 | 307.08 | 320.30 | NOTE | |
| r-release-linux-x86_64 | 0.3.2 | 12.85 | 288.01 | 300.86 | ERROR | |
| r-release-macos-arm64 | 0.3.2 | 156.00 | NOTE | |||
| r-release-macos-x86_64 | 0.3.2 | 277.00 | NOTE | |||
| r-release-windows-x86_64 | 0.3.2 | 16.00 | 277.00 | 293.00 | NOTE | |
| r-oldrel-macos-arm64 | 0.3.2 | 137.00 | NOTE | |||
| r-oldrel-macos-x86_64 | 0.3.2 | 214.00 | NOTE | |||
| r-oldrel-windows-x86_64 | 0.3.2 | 21.00 | 405.00 | 426.00 | NOTE |
Version: 0.3.2
Check: Rd files
Result: NOTE
checkRd: (-1) groupdiff_tau.Rd:23: Lost braces
23 | \code{groupdiff_tau()} computes \eqn{min(x/y, y/x)}, i.e. the smallest symmetric ratio between \eqn{x} and eqn{y}
| ^
Flavors: r-devel-linux-x86_64-debian-clang, r-devel-linux-x86_64-debian-gcc, r-devel-linux-x86_64-fedora-clang, r-devel-linux-x86_64-fedora-gcc, r-devel-windows-x86_64, r-patched-linux-x86_64, r-release-linux-x86_64, r-release-macos-arm64, r-release-macos-x86_64, r-release-windows-x86_64, r-oldrel-macos-arm64, r-oldrel-macos-x86_64, r-oldrel-windows-x86_64
Version: 0.3.2
Check: Rd cross-references
Result: NOTE
Found the following Rd file(s) with Rd \link{} targets missing package
anchors:
MeasureFairness.Rd: mlr_measures_classif.ce,
mlr_measures_classif.fpr, mlr_measures, Task
MeasureFairnessComposite.Rd: Task
MeasureFairnessConstraint.Rd: Task
MeasureSubgroup.Rd: mlr_measures_classif.fpr
compas.Rd: TaskClassif
compute_metrics.Rd: Task
fairness_accuracy_tradeoff.Rd: PredictionClassif, BenchmarkResult,
ResampleResult, Task, Measure, TaskClassif
fairness_compare_metrics.Rd: PredictionClassif, BenchmarkResult,
ResampleResult, Measure, TaskClassif, Task
fairness_prediction_density.Rd: PredictionClassif, ResampleResult,
BenchmarkResult, Task, TaskClassif
fairness_tensor.Rd: data.table, PredictionClassif, ResampleResult,
TaskClassif, Task
groupdiff_tau.Rd: Task
groupwise_metrics.Rd: Task
mlr_learners_classif.fairfgrrm.Rd: Learner, mlr_learners, lrn
mlr_learners_classif.fairzlrm.Rd: Learner, mlr_learners, lrn
mlr_learners_fairness.Rd: Task
mlr_learners_regr.fairfrrm.Rd: Learner, mlr_learners, lrn
mlr_learners_regr.fairnclm.Rd: Learner, mlr_learners, lrn
mlr_learners_regr.fairzlm.Rd: Learner, mlr_learners, lrn
mlr_measures_fairness.Rd: Task
mlr_pipeops_equalized_odds.Rd: R6Class, PipeOpTaskPreproc, PipeOp
mlr_pipeops_explicit_pta.Rd: R6Class, PipeOpTaskPreproc, PipeOp
mlr_pipeops_reweighing.Rd: R6Class, PipeOpTaskPreproc, PipeOp
report_fairness.Rd: Task
task_summary.Rd: Task
Please provide package anchors for all Rd \link{} targets not in the
package itself and the base packages.
Flavors: r-devel-linux-x86_64-debian-clang, r-devel-linux-x86_64-debian-gcc, r-devel-windows-x86_64, r-patched-linux-x86_64, r-release-linux-x86_64, r-release-windows-x86_64
Version: 0.3.2
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
...
--- re-building ‘debiasing-vignette.Rmd’ using rmarkdown
** Processing: /home/hornik/tmp/R.check/r-devel-clang/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/debiasing-vignette_files/figure-html/unnamed-chunk-7-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 13804 bytes
Input file size = 13894 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 10650
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 10650
Output IDAT size = 10650 bytes (3154 bytes decrease)
Output file size = 10728 bytes (3166 bytes = 22.79% decrease)
--- finished re-building ‘debiasing-vignette.Rmd’
--- re-building ‘measures-vignette.Rmd’ using rmarkdown
--- finished re-building ‘measures-vignette.Rmd’
--- re-building ‘reports-vignette.Rmd’ using rmarkdown
Quitting from reports-vignette.Rmd:51-54 [build_modelcard_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `loadNamespace()`:
! there is no package called 'posterdown'
---
Backtrace:
▆
1. ├─rmarkdown::render(rmdfile)
2. │ └─rmarkdown:::create_output_format(output_format$name, output_format$options)
3. │ └─rmarkdown:::create_output_format_function(name)
4. │ └─base::eval(xfun::parse_only(name))
5. │ └─base::eval(xfun::parse_only(name))
6. └─base::loadNamespace(x)
7. └─base::withRestarts(stop(cond), retry_loadNamespace = function() NULL)
8. └─base (local) withOneRestart(expr, restarts[[1L]])
9. └─base (local) doWithOneRestart(return(expr), restart)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
there is no package called 'posterdown'
--- failed re-building ‘reports-vignette.Rmd’
--- re-building ‘visualization-vignette.Rmd’ using rmarkdown
** Processing: /home/hornik/tmp/R.check/r-devel-clang/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-6-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 15453 bytes
Input file size = 15543 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 12321
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 12321
Output IDAT size = 12321 bytes (3132 bytes decrease)
Output file size = 12399 bytes (3144 bytes = 20.23% decrease)
** Processing: /home/hornik/tmp/R.check/r-devel-clang/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-7-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 17084 bytes
Input file size = 17186 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 13203
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 13203
Output IDAT size = 13203 bytes (3881 bytes decrease)
Output file size = 13281 bytes (3905 bytes = 22.72% decrease)
** Processing: /home/hornik/tmp/R.check/r-devel-clang/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-8-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 15941 bytes
Input file size = 16031 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 11661
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 11661
Output IDAT size = 11661 bytes (4280 bytes decrease)
Output file size = 11739 bytes (4292 bytes = 26.77% decrease)
** Processing: /home/hornik/tmp/R.check/r-devel-clang/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-9-1.png
288x288 pixels, 8 bits/pixel, 234 colors in palette
Reducing image to 8 bits/pixel, grayscale
Input IDAT size = 2623 bytes
Input file size = 3415 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 2476
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 2476
Output IDAT size = 2476 bytes (147 bytes decrease)
Output file size = 2554 bytes (861 bytes = 25.21% decrease)
** Processing: /home/hornik/tmp/R.check/r-devel-clang/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-10-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 10260 bytes
Input file size = 10350 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 8046
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 8046
Output IDAT size = 8046 bytes (2214 bytes decrease)
Output file size = 8124 bytes (2226 bytes = 21.51% decrease)
** Processing: /home/hornik/tmp/R.check/r-devel-clang/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-12-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 12711 bytes
Input file size = 12801 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 9267
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 9267
Output IDAT size = 9267 bytes (3444 bytes decrease)
Output file size = 9345 bytes (3456 bytes = 27.00% decrease)
--- finished re-building ‘visualization-vignette.Rmd’
SUMMARY: processing the following file failed:
‘reports-vignette.Rmd’
Error: Vignette re-building failed.
Execution halted
Flavor: r-devel-linux-x86_64-debian-clang
Version: 0.3.2
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
...
--- re-building ‘debiasing-vignette.Rmd’ using rmarkdown
** Processing: /home/hornik/tmp/R.check/r-devel-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/debiasing-vignette_files/figure-html/unnamed-chunk-7-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 13804 bytes
Input file size = 13894 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 10650
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 10650
Output IDAT size = 10650 bytes (3154 bytes decrease)
Output file size = 10728 bytes (3166 bytes = 22.79% decrease)
--- finished re-building ‘debiasing-vignette.Rmd’
--- re-building ‘measures-vignette.Rmd’ using rmarkdown
--- finished re-building ‘measures-vignette.Rmd’
--- re-building ‘reports-vignette.Rmd’ using rmarkdown
Quitting from reports-vignette.Rmd:51-54 [build_modelcard_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `loadNamespace()`:
! there is no package called 'posterdown'
---
Backtrace:
▆
1. ├─rmarkdown::render(rmdfile)
2. │ └─rmarkdown:::create_output_format(output_format$name, output_format$options)
3. │ └─rmarkdown:::create_output_format_function(name)
4. │ └─base::eval(xfun::parse_only(name))
5. │ └─base::eval(xfun::parse_only(name))
6. └─base::loadNamespace(x)
7. └─base::withRestarts(stop(cond), retry_loadNamespace = function() NULL)
8. └─base (local) withOneRestart(expr, restarts[[1L]])
9. └─base (local) doWithOneRestart(return(expr), restart)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
there is no package called 'posterdown'
--- failed re-building ‘reports-vignette.Rmd’
--- re-building ‘visualization-vignette.Rmd’ using rmarkdown
** Processing: /home/hornik/tmp/R.check/r-devel-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-6-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 15438 bytes
Input file size = 15528 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 12391
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 12391
Output IDAT size = 12391 bytes (3047 bytes decrease)
Output file size = 12469 bytes (3059 bytes = 19.70% decrease)
** Processing: /home/hornik/tmp/R.check/r-devel-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-7-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 17340 bytes
Input file size = 17442 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 13329
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 13329
Output IDAT size = 13329 bytes (4011 bytes decrease)
Output file size = 13407 bytes (4035 bytes = 23.13% decrease)
** Processing: /home/hornik/tmp/R.check/r-devel-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-8-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 15327 bytes
Input file size = 15417 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 11536
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 11536
Output IDAT size = 11536 bytes (3791 bytes decrease)
Output file size = 11614 bytes (3803 bytes = 24.67% decrease)
** Processing: /home/hornik/tmp/R.check/r-devel-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-9-1.png
288x288 pixels, 8 bits/pixel, 235 colors in palette
Reducing image to 8 bits/pixel, grayscale
Input IDAT size = 2879 bytes
Input file size = 3674 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 2726
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 2726
Output IDAT size = 2726 bytes (153 bytes decrease)
Output file size = 2804 bytes (870 bytes = 23.68% decrease)
** Processing: /home/hornik/tmp/R.check/r-devel-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-10-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 10271 bytes
Input file size = 10361 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 8089
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 8089
Output IDAT size = 8089 bytes (2182 bytes decrease)
Output file size = 8167 bytes (2194 bytes = 21.18% decrease)
** Processing: /home/hornik/tmp/R.check/r-devel-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-12-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 12711 bytes
Input file size = 12801 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 9267
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 9267
Output IDAT size = 9267 bytes (3444 bytes decrease)
Output file size = 9345 bytes (3456 bytes = 27.00% decrease)
--- finished re-building ‘visualization-vignette.Rmd’
SUMMARY: processing the following file failed:
‘reports-vignette.Rmd’
Error: Vignette re-building failed.
Execution halted
Flavor: r-devel-linux-x86_64-debian-gcc
Version: 0.3.2
Check: examples
Result: ERROR
Running examples in ‘mlr3fairness-Ex.R’ failed
The error most likely occurred in:
> ### Name: MeasureFairness
> ### Title: Base Measure for Fairness
> ### Aliases: MeasureFairness
>
> ### ** Examples
>
> library("mlr3")
> # Create MeasureFairness to measure the Predictive Parity.
> t = tsk("adult_train")
> learner = lrn("classif.rpart", cp = .01)
> learner$train(t)
> measure = msr("fairness", base_measure = msr("classif.ppv"))
> predictions = learner$predict(t)
> predictions$score(measure, task = t)
Error in prediction$clone()$filter(rws)$score(base_measure, task = task, :
unused argument (weights = NULL)
Calls: <Anonymous> ... score_groupwise -> map_dbl -> map_mold -> vapply -> FUN
Execution halted
Flavors: r-devel-linux-x86_64-fedora-clang, r-devel-linux-x86_64-fedora-gcc
Version: 0.3.2
Check: tests
Result: ERROR
Running ‘testthat.R’ [26s/54s]
Running the tests in ‘tests/testthat.R’ failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate")
+ library("mlr3")
+ library("mlr3pipelines")
+ library("mlr3fairness")
+ test_check("mlr3fairness")
+ }
INFO [12:15:07.047] [mlr3] Running benchmark with 12 resampling iterations
INFO [12:15:08.137] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [12:15:08.508] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [12:15:08.738] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [12:15:08.956] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [12:15:09.111] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [12:15:09.340] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [12:15:09.495] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [12:15:09.728] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [12:15:09.901] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [12:15:10.086] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [12:15:10.224] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [12:15:10.330] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [12:15:10.462] [mlr3] Finished benchmark
INFO [12:15:11.784] [mlr3] Running benchmark with 12 resampling iterations
INFO [12:15:12.198] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [12:15:12.360] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [12:15:12.550] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [12:15:12.735] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [12:15:12.876] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [12:15:13.022] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [12:15:13.150] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [12:15:13.305] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [12:15:13.400] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [12:15:13.491] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [12:15:13.542] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [12:15:13.658] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [12:15:13.713] [mlr3] Finished benchmark
INFO [12:15:14.190] [mlr3] Running benchmark with 12 resampling iterations
INFO [12:15:14.220] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [12:15:14.382] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [12:15:14.449] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [12:15:14.516] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [12:15:14.574] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [12:15:14.623] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [12:15:14.711] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [12:15:15.040] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [12:15:15.198] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [12:15:15.329] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [12:15:15.500] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [12:15:15.630] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [12:15:15.764] [mlr3] Finished benchmark
[ FAIL 21 | WARN 14 | SKIP 30 | PASS 99 ]
══ Skipped tests (30) ══════════════════════════════════════════════════════════
• On CRAN (30): 'test_datasets.R:16:3', 'test_datasets.R:32:3',
'test_datasets.R:47:3', 'test_learners_fairml.R:2:5',
'test_learners_fairml.R:12:5', 'test_learners_fairml.R:25:5',
'test_learners_fairml.R:39:5', 'test_learners_fairml.R:51:5',
'test_learners_fairml_ptas.R:2:5', 'test_learners_fairml_ptas.R:17:5',
'test_measure_subgroup.R:47:3', 'test_measure_subgroup.R:66:3',
'test_pipeop_eod.R:2:3', 'test_pipeop_eod.R:17:3', 'test_pipeop_eod.R:57:3',
'test_pipeop_explicit_pta.R:3:5', 'test_pipeop_explicit_pta.R:17:5',
'test_pipeop_reweighing.R:2:3', 'test_pipeop_reweighing.R:15:3',
'test_pipeop_reweighing.R:25:3', 'test_pipeop_reweighing.R:34:3',
'test_pipeop_reweighing.R:51:3', 'test_pipeop_reweighing.R:61:3',
'test_report_modelcard_datasheet.R:2:3',
'test_report_modelcard_datasheet.R:18:3',
'test_report_modelcard_datasheet.R:34:3',
'test_use_modelcard_datasheet.R:2:3', 'test_use_modelcard_datasheet.R:17:3',
'test_use_modelcard_datasheet.R:31:3', 'test_write_files.R:2:3'
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_measure_subgroup.R:20:3'): measure ─────────────────────────────
Error in `prediction$clone()$filter(rws)$score(self$base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─l$train(t)$predict(t)$score(m, t) at test_measure_subgroup.R:20:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureSubgroup__.score(...)
── Error ('test_measure_subgroup.R:32:3'): measure ─────────────────────────────
Error in `prediction$clone()$filter(rws)$score(self$base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─l$train(t)$predict(t)$score(m, t) at test_measure_subgroup.R:32:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureSubgroup__.score(...)
── Error ('test_measures.R:51:9'): fairness measures work as expcted ───────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:51:9
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:71:9'): fairness measures work as expected - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:71:9
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:92:3'): fairness errors on missing pta, works with ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:92:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(prd$score(msr("fairness.acc"), task = task))
5. └─prd$score(msr("fairness.acc"), task = task)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:111:3'): fairness works with non-binary pta ─────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─checkmate::expect_number(...) at test_measures.R:111:3
2. └─prd$score(msr("fairness.acc"), task = task)
3. └─mlr3:::.__Prediction__score(...)
4. └─mlr3misc::map_dbl(...)
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3 (local) FUN(X[[i]], ...)
8. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
9. └─mlr3:::.__Measure__score(...)
10. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
11. └─get_private(measure)$.score(...)
12. └─mlr3fairness:::.__MeasureFairness__.score(...)
13. └─mlr3fairness:::score_groupwise(...)
14. └─mlr3misc::map_dbl(...)
15. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
16. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
17. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:129:3'): fairness works on non-binary target ────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─checkmate::expect_number(...) at test_measures.R:129:3
2. └─prd$score(msr("fairness.acc"), task = task)
3. └─mlr3:::.__Prediction__score(...)
4. └─mlr3misc::map_dbl(...)
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3 (local) FUN(X[[i]], ...)
8. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
9. └─mlr3:::.__Measure__score(...)
10. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
11. └─get_private(measure)$.score(...)
12. └─mlr3fairness:::.__MeasureFairness__.score(...)
13. └─mlr3fairness:::score_groupwise(...)
14. └─mlr3misc::map_dbl(...)
15. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
16. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
17. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:140:3'): fairness.fpr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:140:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(round(predictions$score(msr_obj, test_data), 4))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:145:3'): fairness.acc can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:145:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:150:3'): fairness.fnr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:150:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:155:3'): fairness.tpr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:155:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:160:3'): fairness.ppv can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:160:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:165:3'): fairness.npv can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:165:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:170:3'): fairness.fp can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:170:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:175:3'): fairness.fn can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:175:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:180:3'): fairness.pp (disparate impact score) can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:180:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:194:7'): fairness constraint measures - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─mlr3misc::map(...) at test_measures.R:192:3
2. └─base::lapply(.x, .f, ...)
3. └─mlr3fairness (local) FUN(X[[i]], ...)
4. └─mlr3misc::map_dbl(...) at test_measures.R:193:5
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3fairness (local) FUN(X[[i]], ...)
8. └─prd$score(measures = msr(m), task = tsk) at test_measures.R:194:7
9. └─mlr3:::.__Prediction__score(...)
10. └─mlr3misc::map_dbl(...)
11. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
12. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
13. └─mlr3 (local) FUN(X[[i]], ...)
14. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
15. └─mlr3:::.__Measure__score(...)
16. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
17. └─get_private(measure)$.score(...)
18. └─mlr3fairness:::.__MeasureFairness__.score(...)
19. └─mlr3fairness:::score_groupwise(...)
20. └─mlr3misc::map_dbl(...)
21. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
22. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
23. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:249:3'): Args are passed on correctly ───────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(mfa, task = t, train_set = 1:10) at test_measures.R:249:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:271:11'): fairness measures work as expected - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:271:11
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_visualizations.R:10:5'): fairness_accuracy_tradeoff ────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─mlr3misc::map(...) at test_visualizations.R:9:3
2. └─base::lapply(.x, .f, ...)
3. └─mlr3fairness (local) FUN(X[[i]], ...)
4. ├─mlr3fairness:::check_plots(fairness_accuracy_tradeoff(bmr, fmsr)) at test_visualizations.R:10:5
5. │ ├─testthat::expect_true(is.ggplot(ggplot_obj)) at tests/testthat/helper_test.R:4:3
6. │ │ └─testthat::quasi_label(enquo(object), label, arg = "object")
7. │ │ └─rlang::eval_bare(expr, quo_get_env(quo))
8. │ └─ggplot2::is.ggplot(ggplot_obj)
9. │ └─ggplot2::is_ggplot(x)
10. ├─mlr3fairness::fairness_accuracy_tradeoff(bmr, fmsr)
11. └─mlr3fairness:::fairness_accuracy_tradeoff.BenchmarkResult(...)
12. └─object$aggregate(list(acc_measure, fairness_measure))
13. └─mlr3:::.__BenchmarkResult__aggregate(...)
14. └─mlr3misc::map_dtr(...)
15. ├─data.table::rbindlist(...)
16. ├─base::unname(map(.x, .f, ...))
17. └─mlr3misc::map(.x, .f, ...)
18. └─base::lapply(.x, .f, ...)
19. └─mlr3 (local) FUN(X[[i]], ...)
20. ├─base::as.list(resample_result_aggregate(rr, measures))
21. └─mlr3:::resample_result_aggregate(rr, measures)
22. ├─... %??% set_names(numeric(), character())
23. ├─base::unlist(...)
24. └─mlr3misc::map(...)
25. └─base::lapply(.x, .f, ...)
26. └─mlr3 (local) FUN(X[[i]], ...)
27. └─m$aggregate(rr)
28. └─mlr3:::.__Measure__aggregate(...)
29. └─mlr3:::score_measures(...)
30. └─mlr3misc::pmap_dbl(...)
31. └─mlr3misc:::mapply_list(.f, .x, list(...))
32. └─base::.mapply(.f, .dots, .args)
33. └─mlr3 (local) `<fn>`(...)
34. └─mlr3:::score_single_measure(...)
35. └─get_private(measure)$.score(...)
36. └─mlr3fairness:::.__MeasureFairness__.score(...)
37. └─mlr3fairness:::score_groupwise(...)
38. └─mlr3misc::map_dbl(...)
39. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
40. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
41. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_visualizations.R:33:3'): compare_metrics ───────────────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─mlr3fairness:::check_plots(compare_metrics(bmr, fairness_measures)) at test_visualizations.R:33:3
2. │ ├─testthat::expect_true(is.ggplot(ggplot_obj)) at tests/testthat/helper_test.R:4:3
3. │ │ └─testthat::quasi_label(enquo(object), label, arg = "object")
4. │ │ └─rlang::eval_bare(expr, quo_get_env(quo))
5. │ └─ggplot2::is.ggplot(ggplot_obj)
6. │ └─ggplot2::is_ggplot(x)
7. ├─mlr3fairness::compare_metrics(bmr, fairness_measures)
8. └─mlr3fairness:::compare_metrics.BenchmarkResult(bmr, fairness_measures)
9. └─object$aggregate(measures, ...)
10. └─mlr3:::.__BenchmarkResult__aggregate(...)
11. └─mlr3misc::map_dtr(...)
12. ├─data.table::rbindlist(...)
13. ├─base::unname(map(.x, .f, ...))
14. └─mlr3misc::map(.x, .f, ...)
15. └─base::lapply(.x, .f, ...)
16. └─mlr3 (local) FUN(X[[i]], ...)
17. ├─base::as.list(resample_result_aggregate(rr, measures))
18. └─mlr3:::resample_result_aggregate(rr, measures)
19. ├─... %??% set_names(numeric(), character())
20. ├─base::unlist(...)
21. └─mlr3misc::map(...)
22. └─base::lapply(.x, .f, ...)
23. └─mlr3 (local) FUN(X[[i]], ...)
24. └─m$aggregate(rr)
25. └─mlr3:::.__Measure__aggregate(...)
26. └─mlr3:::score_measures(...)
27. └─mlr3misc::pmap_dbl(...)
28. └─mlr3misc:::mapply_list(.f, .x, list(...))
29. └─base::.mapply(.f, .dots, .args)
30. └─mlr3 (local) `<fn>`(...)
31. └─mlr3:::score_single_measure(...)
32. └─get_private(measure)$.score(...)
33. └─mlr3fairness:::.__MeasureFairness__.score(...)
34. └─mlr3fairness:::score_groupwise(...)
35. └─mlr3misc::map_dbl(...)
36. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
37. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
38. └─mlr3fairness (local) FUN(X[[i]], ...)
[ FAIL 21 | WARN 14 | SKIP 30 | PASS 99 ]
Error: Test failures
Execution halted
Flavor: r-devel-linux-x86_64-fedora-clang
Version: 0.3.2
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
--- re-building ‘debiasing-vignette.Rmd’ using rmarkdown
Quitting from debiasing-vignette.Rmd:55-57 [unnamed-chunk-4]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `task_set_roles()`:
! Assertion on 'roles' failed: Must be a subset of {'feature','target','name','order','stratum','group','offset','weights_learner','weights_measure','pta'}, but has additional elements {'weight'}.
This happened PipeOp reweighing_wts's $train()
---
Backtrace:
▆
1. ├─p1$train(list(task))
2. │ └─mlr3pipelines:::.__PipeOp__train(...)
3. │ ├─base::withCallingHandlers(...)
4. │ └─private$.train(input)
5. │ └─mlr3pipelines:::.__PipeOpTaskPreproc__.train(...)
6. │ └─private$.train_task(intask)
7. │ └─mlr3fairness:::.__PipeOpReweighingWeights__.train_task(...)
8. │ └─task$set_col_roles(weightcolname, "weight")
9. │ └─mlr3:::.__Task__set_col_roles(...)
10. │ └─mlr3:::task_set_roles(...)
11. │ └─checkmate::assert_subset(roles, names(li))
12. │ └─checkmate::makeAssertion(x, res, .var.name, add)
13. │ └─checkmate:::mstop(...)
14. │ └─base::stop(simpleError(sprintf(msg, ...), call.))
15. └─mlr3pipelines (local) `<fn>`(`<smplErrr>`)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'debiasing-vignette.Rmd' failed with diagnostics:
Assertion on 'roles' failed: Must be a subset of {'feature','target','name','order','stratum','group','offset','weights_learner','weights_measure','pta'}, but has additional elements {'weight'}.
This happened PipeOp reweighing_wts's $train()
--- failed re-building ‘debiasing-vignette.Rmd’
--- re-building ‘measures-vignette.Rmd’ using rmarkdown
Quitting from measures-vignette.Rmd:88-90 [unnamed-chunk-6]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error:
! unused argument (weights = NULL)
---
Backtrace:
▆
1. └─prd$score(msr("fairness.tpr"), task = test)
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'measures-vignette.Rmd' failed with diagnostics:
unused argument (weights = NULL)
--- failed re-building ‘measures-vignette.Rmd’
--- re-building ‘reports-vignette.Rmd’ using rmarkdown
Quitting from reports-vignette.Rmd:51-54 [build_modelcard_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `loadNamespace()`:
! there is no package called 'posterdown'
---
Backtrace:
▆
1. ├─rmarkdown::render(rmdfile)
2. │ └─rmarkdown:::create_output_format(output_format$name, output_format$options)
3. │ └─rmarkdown:::create_output_format_function(name)
4. │ └─base::eval(xfun::parse_only(name))
5. │ └─base::eval(xfun::parse_only(name))
6. └─base::loadNamespace(x)
7. └─base::withRestarts(stop(cond), retry_loadNamespace = function() NULL)
8. └─base (local) withOneRestart(expr, restarts[[1L]])
9. └─base (local) doWithOneRestart(return(expr), restart)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
there is no package called 'posterdown'
--- failed re-building ‘reports-vignette.Rmd’
--- re-building ‘visualization-vignette.Rmd’ using rmarkdown
Quitting from visualization-vignette.Rmd:88-90 [unnamed-chunk-8]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error:
! unused argument (weights = NULL)
---
Backtrace:
▆
1. ├─mlr3fairness::fairness_accuracy_tradeoff(bmr, msr("fairness.fpr"))
2. └─mlr3fairness:::fairness_accuracy_tradeoff.BenchmarkResult(...)
3. └─object$aggregate(list(acc_measure, fairness_measure))
4. └─mlr3:::.__BenchmarkResult__aggregate(...)
5. └─mlr3misc::map_dtr(...)
6. ├─data.table::rbindlist(...)
7. ├─base::unname(map(.x, .f, ...))
8. └─mlr3misc::map(.x, .f, ...)
9. └─base::lapply(.x, .f, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. ├─base::as.list(resample_result_aggregate(rr, measures))
12. └─mlr3:::resample_result_aggregate(rr, measures)
13. ├─... %??% set_names(numeric(), character())
14. ├─base::unlist(...)
15. └─mlr3misc::map(...)
16. └─base::lapply(.x, .f, ...)
17. └─mlr3 (local) FUN(X[[i]], ...)
18. └─m$aggregate(rr)
19. └─mlr3:::.__Measure__aggregate(...)
20. └─mlr3:::score_measures(...)
21. └─mlr3misc::pmap_dbl(...)
22. └─mlr3misc:::mapply_list(.f, .x, list(...))
23. └─base::.mapply(.f, .dots, .args)
24. └─mlr3 (local) `<fn>`(...)
25. └─mlr3:::score_single_measure(...)
26. └─get_private(measure)$.score(...)
27. └─mlr3fairness:::.__MeasureFairness__.score(...)
28. └─mlr3fairness:::score_groupwise(...)
29. └─mlr3misc::map_dbl(...)
30. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
31. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
32. └─mlr3fairness (local) FUN(X[[i]], ...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'visualization-vignette.Rmd' failed with diagnostics:
unused argument (weights = NULL)
--- failed re-building ‘visualization-vignette.Rmd’
SUMMARY: processing the following files failed:
‘debiasing-vignette.Rmd’ ‘measures-vignette.Rmd’
‘reports-vignette.Rmd’ ‘visualization-vignette.Rmd’
Error: Vignette re-building failed.
Execution halted
Flavors: r-devel-linux-x86_64-fedora-clang, r-devel-linux-x86_64-fedora-gcc
Version: 0.3.2
Check: tests
Result: ERROR
Running ‘testthat.R’ [25s/150s]
Running the tests in ‘tests/testthat.R’ failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate")
+ library("mlr3")
+ library("mlr3pipelines")
+ library("mlr3fairness")
+ test_check("mlr3fairness")
+ }
INFO [11:15:15.370] [mlr3] Running benchmark with 12 resampling iterations
INFO [11:15:18.125] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [11:15:19.664] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [11:15:20.500] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [11:15:21.030] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [11:15:21.478] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [11:15:21.808] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [11:15:22.113] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [11:15:22.485] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [11:15:22.791] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [11:15:23.192] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [11:15:23.441] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [11:15:23.636] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [11:15:24.157] [mlr3] Finished benchmark
INFO [11:15:27.920] [mlr3] Running benchmark with 12 resampling iterations
INFO [11:15:28.993] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [11:15:29.393] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [11:15:30.154] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [11:15:30.850] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [11:15:31.536] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [11:15:32.177] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [11:15:32.712] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [11:15:33.061] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [11:15:33.458] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [11:15:34.612] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [11:15:35.203] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [11:15:35.732] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [11:15:36.205] [mlr3] Finished benchmark
INFO [11:15:39.218] [mlr3] Running benchmark with 12 resampling iterations
INFO [11:15:39.356] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [11:15:39.718] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [11:15:41.113] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [11:15:41.529] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [11:15:41.818] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [11:15:42.074] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [11:15:42.432] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [11:15:42.873] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [11:15:43.243] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [11:15:43.601] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [11:15:43.941] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [11:15:44.416] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [11:15:44.814] [mlr3] Finished benchmark
[ FAIL 21 | WARN 14 | SKIP 30 | PASS 99 ]
══ Skipped tests (30) ══════════════════════════════════════════════════════════
• On CRAN (30): 'test_datasets.R:16:3', 'test_datasets.R:32:3',
'test_datasets.R:47:3', 'test_learners_fairml.R:2:5',
'test_learners_fairml.R:12:5', 'test_learners_fairml.R:25:5',
'test_learners_fairml.R:39:5', 'test_learners_fairml.R:51:5',
'test_learners_fairml_ptas.R:2:5', 'test_learners_fairml_ptas.R:17:5',
'test_measure_subgroup.R:47:3', 'test_measure_subgroup.R:66:3',
'test_pipeop_eod.R:2:3', 'test_pipeop_eod.R:17:3', 'test_pipeop_eod.R:57:3',
'test_pipeop_explicit_pta.R:3:5', 'test_pipeop_explicit_pta.R:17:5',
'test_pipeop_reweighing.R:2:3', 'test_pipeop_reweighing.R:15:3',
'test_pipeop_reweighing.R:25:3', 'test_pipeop_reweighing.R:34:3',
'test_pipeop_reweighing.R:51:3', 'test_pipeop_reweighing.R:61:3',
'test_report_modelcard_datasheet.R:2:3',
'test_report_modelcard_datasheet.R:18:3',
'test_report_modelcard_datasheet.R:34:3',
'test_use_modelcard_datasheet.R:2:3', 'test_use_modelcard_datasheet.R:17:3',
'test_use_modelcard_datasheet.R:31:3', 'test_write_files.R:2:3'
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_measure_subgroup.R:20:3'): measure ─────────────────────────────
Error in `prediction$clone()$filter(rws)$score(self$base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─l$train(t)$predict(t)$score(m, t) at test_measure_subgroup.R:20:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureSubgroup__.score(...)
── Error ('test_measure_subgroup.R:32:3'): measure ─────────────────────────────
Error in `prediction$clone()$filter(rws)$score(self$base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─l$train(t)$predict(t)$score(m, t) at test_measure_subgroup.R:32:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureSubgroup__.score(...)
── Error ('test_measures.R:51:9'): fairness measures work as expcted ───────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:51:9
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:71:9'): fairness measures work as expected - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:71:9
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:92:3'): fairness errors on missing pta, works with ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:92:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(prd$score(msr("fairness.acc"), task = task))
5. └─prd$score(msr("fairness.acc"), task = task)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:111:3'): fairness works with non-binary pta ─────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─checkmate::expect_number(...) at test_measures.R:111:3
2. └─prd$score(msr("fairness.acc"), task = task)
3. └─mlr3:::.__Prediction__score(...)
4. └─mlr3misc::map_dbl(...)
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3 (local) FUN(X[[i]], ...)
8. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
9. └─mlr3:::.__Measure__score(...)
10. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
11. └─get_private(measure)$.score(...)
12. └─mlr3fairness:::.__MeasureFairness__.score(...)
13. └─mlr3fairness:::score_groupwise(...)
14. └─mlr3misc::map_dbl(...)
15. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
16. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
17. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:129:3'): fairness works on non-binary target ────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─checkmate::expect_number(...) at test_measures.R:129:3
2. └─prd$score(msr("fairness.acc"), task = task)
3. └─mlr3:::.__Prediction__score(...)
4. └─mlr3misc::map_dbl(...)
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3 (local) FUN(X[[i]], ...)
8. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
9. └─mlr3:::.__Measure__score(...)
10. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
11. └─get_private(measure)$.score(...)
12. └─mlr3fairness:::.__MeasureFairness__.score(...)
13. └─mlr3fairness:::score_groupwise(...)
14. └─mlr3misc::map_dbl(...)
15. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
16. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
17. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:140:3'): fairness.fpr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:140:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(round(predictions$score(msr_obj, test_data), 4))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:145:3'): fairness.acc can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:145:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:150:3'): fairness.fnr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:150:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:155:3'): fairness.tpr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:155:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:160:3'): fairness.ppv can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:160:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:165:3'): fairness.npv can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:165:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:170:3'): fairness.fp can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:170:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:175:3'): fairness.fn can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:175:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:180:3'): fairness.pp (disparate impact score) can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:180:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:194:7'): fairness constraint measures - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─mlr3misc::map(...) at test_measures.R:192:3
2. └─base::lapply(.x, .f, ...)
3. └─mlr3fairness (local) FUN(X[[i]], ...)
4. └─mlr3misc::map_dbl(...) at test_measures.R:193:5
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3fairness (local) FUN(X[[i]], ...)
8. └─prd$score(measures = msr(m), task = tsk) at test_measures.R:194:7
9. └─mlr3:::.__Prediction__score(...)
10. └─mlr3misc::map_dbl(...)
11. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
12. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
13. └─mlr3 (local) FUN(X[[i]], ...)
14. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
15. └─mlr3:::.__Measure__score(...)
16. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
17. └─get_private(measure)$.score(...)
18. └─mlr3fairness:::.__MeasureFairness__.score(...)
19. └─mlr3fairness:::score_groupwise(...)
20. └─mlr3misc::map_dbl(...)
21. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
22. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
23. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:249:3'): Args are passed on correctly ───────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(mfa, task = t, train_set = 1:10) at test_measures.R:249:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:271:11'): fairness measures work as expected - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:271:11
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_visualizations.R:10:5'): fairness_accuracy_tradeoff ────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─mlr3misc::map(...) at test_visualizations.R:9:3
2. └─base::lapply(.x, .f, ...)
3. └─mlr3fairness (local) FUN(X[[i]], ...)
4. ├─mlr3fairness:::check_plots(fairness_accuracy_tradeoff(bmr, fmsr)) at test_visualizations.R:10:5
5. │ ├─testthat::expect_true(is.ggplot(ggplot_obj)) at tests/testthat/helper_test.R:4:3
6. │ │ └─testthat::quasi_label(enquo(object), label, arg = "object")
7. │ │ └─rlang::eval_bare(expr, quo_get_env(quo))
8. │ └─ggplot2::is.ggplot(ggplot_obj)
9. │ └─ggplot2::is_ggplot(x)
10. ├─mlr3fairness::fairness_accuracy_tradeoff(bmr, fmsr)
11. └─mlr3fairness:::fairness_accuracy_tradeoff.BenchmarkResult(...)
12. └─object$aggregate(list(acc_measure, fairness_measure))
13. └─mlr3:::.__BenchmarkResult__aggregate(...)
14. └─mlr3misc::map_dtr(...)
15. ├─data.table::rbindlist(...)
16. ├─base::unname(map(.x, .f, ...))
17. └─mlr3misc::map(.x, .f, ...)
18. └─base::lapply(.x, .f, ...)
19. └─mlr3 (local) FUN(X[[i]], ...)
20. ├─base::as.list(resample_result_aggregate(rr, measures))
21. └─mlr3:::resample_result_aggregate(rr, measures)
22. ├─... %??% set_names(numeric(), character())
23. ├─base::unlist(...)
24. └─mlr3misc::map(...)
25. └─base::lapply(.x, .f, ...)
26. └─mlr3 (local) FUN(X[[i]], ...)
27. └─m$aggregate(rr)
28. └─mlr3:::.__Measure__aggregate(...)
29. └─mlr3:::score_measures(...)
30. └─mlr3misc::pmap_dbl(...)
31. └─mlr3misc:::mapply_list(.f, .x, list(...))
32. └─base::.mapply(.f, .dots, .args)
33. └─mlr3 (local) `<fn>`(...)
34. └─mlr3:::score_single_measure(...)
35. └─get_private(measure)$.score(...)
36. └─mlr3fairness:::.__MeasureFairness__.score(...)
37. └─mlr3fairness:::score_groupwise(...)
38. └─mlr3misc::map_dbl(...)
39. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
40. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
41. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_visualizations.R:33:3'): compare_metrics ───────────────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─mlr3fairness:::check_plots(compare_metrics(bmr, fairness_measures)) at test_visualizations.R:33:3
2. │ ├─testthat::expect_true(is.ggplot(ggplot_obj)) at tests/testthat/helper_test.R:4:3
3. │ │ └─testthat::quasi_label(enquo(object), label, arg = "object")
4. │ │ └─rlang::eval_bare(expr, quo_get_env(quo))
5. │ └─ggplot2::is.ggplot(ggplot_obj)
6. │ └─ggplot2::is_ggplot(x)
7. ├─mlr3fairness::compare_metrics(bmr, fairness_measures)
8. └─mlr3fairness:::compare_metrics.BenchmarkResult(bmr, fairness_measures)
9. └─object$aggregate(measures, ...)
10. └─mlr3:::.__BenchmarkResult__aggregate(...)
11. └─mlr3misc::map_dtr(...)
12. ├─data.table::rbindlist(...)
13. ├─base::unname(map(.x, .f, ...))
14. └─mlr3misc::map(.x, .f, ...)
15. └─base::lapply(.x, .f, ...)
16. └─mlr3 (local) FUN(X[[i]], ...)
17. ├─base::as.list(resample_result_aggregate(rr, measures))
18. └─mlr3:::resample_result_aggregate(rr, measures)
19. ├─... %??% set_names(numeric(), character())
20. ├─base::unlist(...)
21. └─mlr3misc::map(...)
22. └─base::lapply(.x, .f, ...)
23. └─mlr3 (local) FUN(X[[i]], ...)
24. └─m$aggregate(rr)
25. └─mlr3:::.__Measure__aggregate(...)
26. └─mlr3:::score_measures(...)
27. └─mlr3misc::pmap_dbl(...)
28. └─mlr3misc:::mapply_list(.f, .x, list(...))
29. └─base::.mapply(.f, .dots, .args)
30. └─mlr3 (local) `<fn>`(...)
31. └─mlr3:::score_single_measure(...)
32. └─get_private(measure)$.score(...)
33. └─mlr3fairness:::.__MeasureFairness__.score(...)
34. └─mlr3fairness:::score_groupwise(...)
35. └─mlr3misc::map_dbl(...)
36. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
37. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
38. └─mlr3fairness (local) FUN(X[[i]], ...)
[ FAIL 21 | WARN 14 | SKIP 30 | PASS 99 ]
Error: Test failures
Execution halted
Flavor: r-devel-linux-x86_64-fedora-gcc
Version: 0.3.2
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
...
--- re-building ‘debiasing-vignette.Rmd’ using rmarkdown
** Processing: /home/hornik/tmp/R.check/r-release-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/debiasing-vignette_files/figure-html/unnamed-chunk-7-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 13804 bytes
Input file size = 13894 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 10650
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 10650
Output IDAT size = 10650 bytes (3154 bytes decrease)
Output file size = 10728 bytes (3166 bytes = 22.79% decrease)
--- finished re-building ‘debiasing-vignette.Rmd’
--- re-building ‘measures-vignette.Rmd’ using rmarkdown
--- finished re-building ‘measures-vignette.Rmd’
--- re-building ‘reports-vignette.Rmd’ using rmarkdown
Quitting from reports-vignette.Rmd:51-54 [build_modelcard_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `loadNamespace()`:
! there is no package called 'posterdown'
---
Backtrace:
▆
1. ├─rmarkdown::render(rmdfile)
2. │ └─rmarkdown:::create_output_format(output_format$name, output_format$options)
3. │ └─rmarkdown:::create_output_format_function(name)
4. │ └─base::eval(xfun::parse_only(name))
5. │ └─base::eval(xfun::parse_only(name))
6. └─base::loadNamespace(x)
7. └─base::withRestarts(stop(cond), retry_loadNamespace = function() NULL)
8. └─base (local) withOneRestart(expr, restarts[[1L]])
9. └─base (local) doWithOneRestart(return(expr), restart)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
there is no package called 'posterdown'
--- failed re-building ‘reports-vignette.Rmd’
--- re-building ‘visualization-vignette.Rmd’ using rmarkdown
** Processing: /home/hornik/tmp/R.check/r-release-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-6-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 15566 bytes
Input file size = 15656 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 12341
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 12341
Output IDAT size = 12341 bytes (3225 bytes decrease)
Output file size = 12419 bytes (3237 bytes = 20.68% decrease)
** Processing: /home/hornik/tmp/R.check/r-release-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-7-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 18274 bytes
Input file size = 18376 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 13673
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 13673
Output IDAT size = 13673 bytes (4601 bytes decrease)
Output file size = 13751 bytes (4625 bytes = 25.17% decrease)
** Processing: /home/hornik/tmp/R.check/r-release-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-8-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 15431 bytes
Input file size = 15521 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 11702
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 11702
Output IDAT size = 11702 bytes (3729 bytes decrease)
Output file size = 11780 bytes (3741 bytes = 24.10% decrease)
** Processing: /home/hornik/tmp/R.check/r-release-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-9-1.png
288x288 pixels, 8 bits/pixel, 235 colors in palette
Reducing image to 8 bits/pixel, grayscale
Input IDAT size = 2829 bytes
Input file size = 3624 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 2678
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 2678
Output IDAT size = 2678 bytes (151 bytes decrease)
Output file size = 2756 bytes (868 bytes = 23.95% decrease)
** Processing: /home/hornik/tmp/R.check/r-release-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-10-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 10500 bytes
Input file size = 10590 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 8108
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 8108
Output IDAT size = 8108 bytes (2392 bytes decrease)
Output file size = 8186 bytes (2404 bytes = 22.70% decrease)
** Processing: /home/hornik/tmp/R.check/r-release-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-12-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 12711 bytes
Input file size = 12801 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 9267
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 9267
Output IDAT size = 9267 bytes (3444 bytes decrease)
Output file size = 9345 bytes (3456 bytes = 27.00% decrease)
--- finished re-building ‘visualization-vignette.Rmd’
SUMMARY: processing the following file failed:
‘reports-vignette.Rmd’
Error: Vignette re-building failed.
Execution halted
Flavor: r-release-linux-x86_64