| S3 extraction function for DataSetList | [.DataSetList |
| S3 generic == operator for DataSets | ==.DataSet |
| S3 sort function for DataSetList | arrange arrange.DataSetList |
| S3 generic as.character operator for DataSet | as.character.DataSet |
| Area Under Curve (Empirical Cumulative Dsitribution Function) | AUC AUC.ECDF |
| Bootstrapping for running time samples | bootstrap_RT |
| S3 concatenation function for DataSet | c.DataSet |
| S3 concatenation function for DataSetList | c.DataSetList |
| S3 generic cat operator for DataSet | cat.DataSet |
| Add unique identifiers to each DataSet in the provided DataSetList based on static attributes | change_id |
| Verify that the credentials for DSCtool have been set | check_dsc_configured |
| Check the format of data | check_format |
| Clean DataSetList object by concatenating DataSets | clean_DataSetList |
| Constructor of S3 class 'DataSet' | DataSet |
| S3 constructor of the 'DataSetList' | DataSetList |
| Example DataSetList used in tests / examples | dsl |
| Larger example DataSetList used in tests / examples | dsl_large |
| Empirical Cumulative Dsitribution Function of Runtime of a single data set | ECDF ECDF.DataSet ECDF.DataSetList |
| Function to get just the RT samples needed, without any formatting to improve speed | fast_RT_samples |
| Generate dataframe of a single function/dimension pair | generate_data.Aggr |
| Generate dataframe containing the AUC for any ECDF-curves | generate_data.AUC |
| Generate data for the cumulative difference plot. | generate_data.CDP |
| Generate dataframe consisting of the levelsets of the EAF | generate_data.EAF |
| Generate EAF-differences between each function and the remaining portfolio | generate_data.EAF_diff_Approximate |
| Generate differences between two EAFs | generate_data.EAF_Difference |
| Generate dataframe of a single function/dimension pair | generate_data.ECDF |
| Generate dataframe consisting of the ECDF-equivalent based on the EAF | generate_data.ECDF_From_EAF |
| Generate dataframe of a the unaggregated values of individual algorithms. Stripped-down version of | generate_data.ECDF_raw |
| Nevergrad-dashboard based algorithm comparison | generate_data.Heatmaps |
| Generate dataframe of a single function/dimension pair | generate_data.hist |
| Generate dataframe of exactly 2 parameters, matched by running time | generate_data.Parameter_correlation |
| Generate dataframe of a single function/dimension pair | generate_data.Parameters |
| Generate dataframe of a single function/dimension pair for creating PDF or PMF plots | generate_data.PMF |
| Generate dataframe of a single function/dimension pair | generate_data.Single_Function |
| Get all algorithm ids present in a DataSetList | get_algId |
| Get colors according to the current colorScheme of the IOHanalyzer | get_color_scheme |
| Get datatable of current color (and linestyle) scheme to file | get_color_scheme_dt |
| Generate ECDF targets for a DataSetList | get_default_ECDF_targets |
| Get all dimensions present in a DataSetList | get_dim |
| Perform omnibus statistical tests on the matrix of rankings from the DSCtool api | get_dsc_omnibus |
| Perform post-hoc processing on data from DSCtool | get_dsc_posthoc |
| Get the matrix of rankings using the DSCtool api for a DataSetList | get_dsc_rank |
| Generation of default ECDF-targets | get_ECDF_targets |
| Get Expected RunTime | get_ERT get_ERT.DataSet get_ERT.DataSetList |
| Get all function ids present in a DataSetList | get_funcId |
| Get all function names present in a DataSetList | get_funcName |
| Get all function values present in a DataSetList | get_funvals |
| Get function value matrix of the used dataset. | get_FV get_FV.DataSet |
| Get Function Value condensed overview | get_FV_overview get_FV_overview.DataSet get_FV_overview.DataSetList |
| Get Funtion Value Samples | get_FV_sample get_FV_sample.DataSet get_FV_sample.DataSetList |
| Get Function Value Summary | get_FV_summary get_FV_summary.DataSet get_FV_summary.DataSetList |
| Get condensed overview of datasets | get_id get_id.DataSet get_id.DataSetList |
| Get line styles according to the current styleScheme of the IOHanalyzer | get_line_style |
| Get the marginal contribution of an algorithm to a portfolio | get_marg_contrib_ecdf |
| Get the maximal running time | get_maxRT get_maxRT.DataSet get_maxRT.DataSetList |
| Get the list of available options for data from the OPTION ontology | get_ontology_data |
| Get the list of available options for data from the OPTION ontology | get_ontology_var |
| Get condensed overview of datasets | get_overview get_overview.DataSet get_overview.DataSetList |
| Get the parameter names of the algorithm | get_PAR_name get_PAR_name.DataSet |
| Get Parameter Value Samples | get_PAR_sample get_PAR_sample.DataSet get_PAR_sample.DataSetList |
| Get Parameter Value Summary | get_PAR_summary get_PAR_summary.DataSet get_PAR_summary.DataSetList |
| Get all parameter ids present in a DataSetList | get_parId |
| Extract the position information from a datasetlist object | get_position_dsl |
| Get runtime matrix of the used dataset. | get_RT get_RT.DataSet |
| Get Runtime Value condensed overview | get_RT_overview get_RT_overview.DataSet get_RT_overview.DataSetList |
| Get RunTime Sample | get_RT_sample get_RT_sample.DataSet get_RT_sample.DataSetList |
| Get RunTime Summary | get_RT_summary get_RT_summary.DataSet get_RT_summary.DataSetList |
| Get all runtime values present in a DataSetList | get_runtimes |
| Get the shapley-values of a portfolio of algorithms | get_shapley_values |
| Get all options for a specific attribute which can be used to subset a DataSetList | get_static_attribute_values |
| Get all attributes which can be used to subset a DataSetList | get_static_attributes |
| Generate datatables of runtime or function value targets for a DataSetList | get_target_dt |
| Glicko2 raning of algorithms | glicko2_ranking |
| Template for creating plots in the IOHanalyzer-style | IOH_plot_ly_default |
| IOHanalyzer: Data Analysis Part of IOHprofiler | IOHanalyzer-package IOHanalyzer |
| Reduce the size of the data set by evenly subsampling the records | limit.data |
| Get the ERT-values for all DataSets in a DataSetList at certain targets | max_ERTs max_ERTs.DataSetList |
| Get the expected function-values for all DataSets in a DataSetList at certain runtimes | mean_FVs mean_FVs.DataSetList |
| Performs a pairwise Kolmogorov-Smirnov test on the bootstrapped running times among a data set | pairwise.test pairwise.test.DataSetList pairwise.test.list |
| Create EAF-based polygon plots | plot_eaf_data |
| Create EAF-difference contour plots | plot_eaf_differences |
| General function for plotting within IOHanalyzer | plot_general_data |
| Plot a heatmap according to the specifications from the Nevergrad dashboard | Plot.Comparison.Heatmap Plot.Comparison.Heatmap.DataSetList |
| Plot the cumulative difference plot given a DataSetList. | Plot.cumulative_difference_plot |
| Plot expected function value-based comparison over multiple functions or dimensions | Plot.FV.Aggregated Plot.FV.Aggregated.DataSetList |
| Radarplot of the area under the aggregated ECDF-curve of a DataSetList. | Plot.FV.ECDF_AUC Plot.FV.ECDF_AUC.DataSetList |
| Plot the empirical cumulative distriburtion as a function of the target values of a DataSetList at certain target runtimes | Plot.FV.ECDF_Per_Target Plot.FV.ECDF_Per_Target.DataSetList |
| Plot the aggregated empirical cumulative distriburtion as a function of the function values of a DataSetList. | Plot.FV.ECDF_Single_Func Plot.FV.ECDF_Single_Func.DataSetList |
| Plot histograms of the function values of a DataSetList at a certain target runtime | Plot.FV.Histogram Plot.FV.Histogram.DataSetList |
| Plot FV-plots for multiple functions or dimensions | Plot.FV.Multi_Func Plot.FV.Multi_Func.DataSetList |
| Plot the parameter values recorded in a DataSetList (aligned by budget) | Plot.FV.Parameters Plot.FV.Parameters.DataSetList |
| Plot probablity density function of the function values of a DataSetList at a certain target runtime | Plot.FV.PDF Plot.FV.PDF.DataSetList |
| Plot lineplot of the expected function values of a DataSetList | Plot.FV.Single_Func Plot.FV.Single_Func.DataSetList |
| Create the PerformViz plot | Plot.Performviz |
| Plot ERT-based comparison over multiple functions or dimensions | Plot.RT.Aggregated Plot.RT.Aggregated.DataSetList |
| Radarplot of the area under the aggregated ECDF-curve of a DataSetList. | Plot.RT.ECDF_AUC Plot.RT.ECDF_AUC.DataSetList |
| Plot the aggregated empirical cumulative distriburtion as a function of the running times of a DataSetList. Aggregated over multiple functions or dimensions. | Plot.RT.ECDF_Multi_Func Plot.RT.ECDF_Multi_Func.DataSetList |
| Plot the empirical cumulative distriburtion as a function of the running times of a DataSetList at certain target function values | Plot.RT.ECDF_Per_Target Plot.RT.ECDF_Per_Target.DataSetList |
| Plot the aggregated empirical cumulative distriburtion as a function of the running times of a DataSetList. | Plot.RT.ECDF_Single_Func Plot.RT.ECDF_Single_Func.DataSetList |
| Plot histograms of the runtimes of a DataSetList at a certain target function value | Plot.RT.Histogram Plot.RT.Histogram.DataSetList |
| Plot ERT-plots for multiple functions or dimensions | Plot.RT.Multi_Func Plot.RT.Multi_Func.DataSetList |
| Plot the parameter values recorded in a DataSetList (aligned by funcion value) | Plot.RT.Parameters Plot.RT.Parameters.DataSetList |
| Plot probablity mass function of the runtimes of a DataSetList at a certain target function value | Plot.RT.PMF Plot.RT.PMF.DataSetList |
| Plot lineplot of the ERTs of a DataSetList | Plot.RT.Single_Func Plot.RT.Single_Func.DataSetList |
| Create a candlestick plot of Glicko2-rankings | Plot.Stats.Glicko2_Candlestick Plot.Stats.Glicko2_Candlestick.DataSetList |
| Plot a network graph showing the statistically different algorithms | Plot.Stats.Significance_Graph Plot.Stats.Significance_Graph.DataSetList |
| Plot a heatmap showing the statistically different algorithms | Plot.Stats.Significance_Heatmap Plot.Stats.Significance_Heatmap.DataSetList |
| S3 generic print operator for DataSet | print.DataSet |
| S3 print function for DataSetList | print.DataSetList |
| Read .info files and extract information | read_index_file |
| Read Nevergrad data | read_IOH_v1plus |
| Read Nevergrad data | read_pure_csv |
| Register an account to the DSCtool API | register_DSC |
| Create a shiny-server GUI to interactively use the IOHanalyzer | runServer |
| Save plotly figure in multiple format | save_plotly |
| Save DataTable in multiple formats | save_table |
| Scan *.info files for IOHProfiler or COCO | scan_index_file |
| Function for generating sequences of function values | seq_FV |
| Function for generating sequences of runtime values | seq_RT |
| Set the colorScheme of the IOHanalyzer plots | set_color_scheme |
| Register an account to the DSCtool API | set_DSC_credentials |
| Estimator 'SP' for the Expected Running Time (ERT) | SP |
| S3 subset function for DataSet | subset.DataSet |
| Filter a DataSetList by some criteria | subset.DataSetList |
| S3 generic summary operator for DataSet | summary.DataSet |
| S3 summary function for DataSetList | summary.DataSetList |
