Benchmarks
|
The models currently being benchmarked are still rather
small, since the optimization phase hasn't officially
started yet and the runtime of RefChecker is still
rather high. Once the preformance improves a little
more we will add larger benchmarks to the benchmark suite.
Legend:
DP_n : Dining Philosphers w/id, with n philosphers
Dummy_n : Dummy resetter with n philosophers
RP_n : Russian philosophers with n russians and n dining
RP_n_m : Russian philosophers with n russians and m dining
Model stats:
DP_3:
-----
node_count : 26
edge_count : 51
DP_4:
-----
node_count : 80
edge_count : 212
Dummy_3:
--------
node_count : 30
edge_count : 58
RP_2:
-----
node_count : 188
edge_count : 482
RP_2_3:
-------
node_count : 1081
edge_count : 4004
RP_3_2:
-------
node_count : 2586
edge_count : 9915
Performance results:
The values given are state space generation time
measured in seconds.
Models\Versions: 0.1.8 0.1.9
-----------------------------------------------------------------------
DP_3 0.420 0.380
DP_4 2.280 1.720
Dummy_3 0.590 0.550
RP_2 12.890 7.290
RP_2_3 404.290 67.950
RP_3_2 ----- 184.200
|