moabb.analysis.meta_analysis.find_significant_differences

moabb.analysis.meta_analysis.find_significant_differences(df, perm_cutoff=20)[source][source]

Compute differences between pipelines across datasets

Compute matrix of p-values for all algorithms over all datasets via combined p-values method

Parameters
  • df (DataFrame) – Table of effect and p-values for each dataset and all pipelines, returned by compute_dataset_statistics

  • perm_cutoff (int, default=20) – threshold value to stop using permutation tests, which can be very expensive computationally, using Wilcoxon rank-sum test instead

Returns

  • dfP (DataFrame of shape (n_pipelines, n_pipelines)) – p-values per algorithm pairs

  • dfT (DataFrame of shape (n_pipelines, n_pipelines)) – signed standardized mean differences