Benchmark Descriptions

The following sets of benchmarks were used in the evaluation:

In the following these sets are characterized in more detail.

Linkage1 / WCSP

bn2o

Diagnose

Grids

Linkage 2

Promedas

UAI06-MPE and UAI06-PE

Relational


Benchmarks

All benchmarks are available for download here. Lists of networks used, or subsets of networks used, are also given. Note that each network was assigned (arbitrarily) an ID, for purposes of the evaluation.

Networks are specified in the evaluation FileFormat, with accompanying evidence.


Summary tables

These tables summarize the benchmark instances used with exact solvers for MAR and PE.

('Bayes' and 'Markov' show whether the set contains Bayesian or Markov networks, 'Binary' whether the instances have binary variables only.)

Set

Bayes

Markov

Binary

Weighted-CSP

97

x

x

bn2o

18

x

x

Diagnosis

100

x

Grids

320

x

x

Linkage 2

22

x

Promedas

238

x

x

UAI06-MPE

57

x

UAI06-PE

78

x

Relational

251

x

x

TOTAL

1181

824

357

323

Due to time constraints, MPE and all approximate solvers were run on a reduced set of instances, as shown in the following table:

Set

Bayes

Markov

Binary

Weighted-CSP

97

x

x

bn2o

18

x

x

Diagnosis

0/100

x

Grids

32/320

x

x

Linkage 2

22

x

Promedas

238

x

x

UAI06-MPE

57

x

UAI06-PE

78

x

Relational

35/251

x

x

TOTAL

577

220

357

323

Evaluation/Report/Benchmarks (last edited 2008-09-10 04:35:32 by ArthurChoi)