- include link to one-page executive summary in README - update dashboard section in evaluation HTML to reference summary - revise report metadata to reflect additional CSV tables generated
4.0 KiB
4.0 KiB
| 1 | format | query | scale_gb | projected_wall_s | projected_wall | flag |
|---|---|---|---|---|---|---|
| 2 | CSV | q1 | 600 | 0.06 | 0.06 s | OK |
| 3 | CSV | q1 | 1200 | 0.06 | 0.06 s | OK |
| 4 | CSV | q1 | 6000 | 0.06 | 0.06 s | OK |
| 5 | CSV | q2 | 600 | 428.301 | 7.1 min | OK |
| 6 | CSV | q2 | 1200 | 856.543 | 14.3 min | OK |
| 7 | CSV | q2 | 6000 | 4282.474 | 71.4 min | IMPRACTICAL |
| 8 | CSV | q3 | 600 | 4408.0 | 73.5 min | IMPRACTICAL |
| 9 | CSV | q3 | 1200 | 8815.94 | 2.4 h | IMPRACTICAL |
| 10 | CSV | q3 | 6000 | 44079.46 | 12.2 h | IMPRACTICAL |
| 11 | CSV | q4 | 600 | 2643.775 | 44.1 min | OK |
| 12 | CSV | q4 | 1200 | 5287.489 | 88.1 min | IMPRACTICAL |
| 13 | CSV | q4 | 6000 | 26437.206 | 7.3 h | IMPRACTICAL |
| 14 | CSV | q5 | 600 | 4176.725 | 69.6 min | IMPRACTICAL |
| 15 | CSV | q5 | 1200 | 8353.391 | 2.3 h | IMPRACTICAL |
| 16 | CSV | q5 | 6000 | 41766.715 | 11.6 h | IMPRACTICAL |
| 17 | CSV | q6 | 600 | 870.266 | 14.5 min | OK |
| 18 | CSV | q6 | 1200 | 1740.472 | 29.0 min | OK |
| 19 | CSV | q6 | 6000 | 8702.119 | 2.4 h | IMPRACTICAL |
| 20 | CSV | q7 | 600 | 4897.995 | 81.6 min | IMPRACTICAL |
| 21 | CSV | q7 | 1200 | 9795.931 | 2.7 h | IMPRACTICAL |
| 22 | CSV | q7 | 6000 | 48979.414 | 13.6 h | IMPRACTICAL |
| 23 | JSON-LD | q1 | 600 | 0.111 | 0.11 s | OK |
| 24 | JSON-LD | q1 | 1200 | 0.111 | 0.11 s | OK |
| 25 | JSON-LD | q1 | 6000 | 0.111 | 0.11 s | OK |
| 26 | JSON-LD | q2 | 600 | 5519.622 | 92.0 min | IMPRACTICAL |
| 27 | JSON-LD | q2 | 1200 | 11039.133 | 3.1 h | IMPRACTICAL |
| 28 | JSON-LD | q2 | 6000 | 55195.222 | 15.3 h | IMPRACTICAL |
| 29 | JSON-LD | q3 | 600 | 39673.993 | 11.0 h | IMPRACTICAL |
| 30 | JSON-LD | q3 | 1200 | 79347.876 | 22.0 h | IMPRACTICAL |
| 31 | JSON-LD | q3 | 6000 | 396738.933 | 4.6 d | FAIL |
| 32 | JSON-LD | q4 | 600 | 39597.306 | 11.0 h | IMPRACTICAL |
| 33 | JSON-LD | q4 | 1200 | 79194.5 | 22.0 h | IMPRACTICAL |
| 34 | JSON-LD | q4 | 6000 | 395972.054 | 4.6 d | FAIL |
| 35 | JSON-LD | q5 | 600 | 39760.772 | 11.0 h | IMPRACTICAL |
| 36 | JSON-LD | q5 | 1200 | 79521.432 | 22.1 h | IMPRACTICAL |
| 37 | JSON-LD | q5 | 6000 | 397606.717 | 4.6 d | FAIL |
| 38 | JSON-LD | q6 | 600 | 39076.231 | 10.9 h | IMPRACTICAL |
| 39 | JSON-LD | q6 | 1200 | 78152.351 | 21.7 h | IMPRACTICAL |
| 40 | JSON-LD | q6 | 6000 | 390761.312 | 4.5 d | FAIL |
| 41 | JSON-LD | q7 | 600 | 40228.164 | 11.2 h | IMPRACTICAL |
| 42 | JSON-LD | q7 | 1200 | 80456.218 | 22.3 h | IMPRACTICAL |
| 43 | JSON-LD | q7 | 6000 | 402280.643 | 4.7 d | FAIL |
| 44 | SQLite | q1 | 600 | 0.062 | 0.06 s | OK |
| 45 | SQLite | q1 | 1200 | 0.063 | 0.06 s | OK |
| 46 | SQLite | q1 | 6000 | 0.063 | 0.06 s | OK |
| 47 | SQLite | q2 | 600 | 1.271 | 1.27 s | OK |
| 48 | SQLite | q2 | 1200 | 2.482 | 2.48 s | OK |
| 49 | SQLite | q2 | 6000 | 12.169 | 12 s | OK |
| 50 | SQLite | q3 | 600 | 339.238 | 5.7 min | OK |
| 51 | SQLite | q3 | 1200 | 699.328 | 11.7 min | OK |
| 52 | SQLite | q3 | 6000 | 3739.195 | 62.3 min | IMPRACTICAL |
| 53 | SQLite | q4 | 600 | 0.06 | 0.06 s | OK |
| 54 | SQLite | q4 | 1200 | 0.06 | 0.06 s | OK |
| 55 | SQLite | q4 | 6000 | 0.06 | 0.06 s | OK |
| 56 | SQLite | q5 | 600 | 2847.603 | 47.5 min | OK |
| 57 | SQLite | q5 | 1200 | 5695.146 | 94.9 min | IMPRACTICAL |
| 58 | SQLite | q5 | 6000 | 28475.49 | 7.9 h | IMPRACTICAL |
| 59 | SQLite | q6 | 600 | 5.18 | 5.18 s | OK |
| 60 | SQLite | q6 | 1200 | 10.615 | 11 s | OK |
| 61 | SQLite | q6 | 6000 | 56.5 | 56 s | OK |
| 62 | SQLite | q7 | 600 | 2619.558 | 43.7 min | OK |
| 63 | SQLite | q7 | 1200 | 5239.055 | 87.3 min | IMPRACTICAL |
| 64 | SQLite | q7 | 6000 | 26195.034 | 7.3 h | IMPRACTICAL |
| 65 | PostgreSQL | q1 | 600 | 0.222 | 0.22 s | OK |
| 66 | PostgreSQL | q1 | 1200 | 0.222 | 0.22 s | OK |
| 67 | PostgreSQL | q1 | 6000 | 0.222 | 0.22 s | OK |
| 68 | PostgreSQL | q2 | 600 | 0.221 | 0.22 s | OK |
| 69 | PostgreSQL | q2 | 1200 | 0.221 | 0.22 s | OK |
| 70 | PostgreSQL | q2 | 6000 | 0.221 | 0.22 s | OK |
| 71 | PostgreSQL | q3 | 600 | 3.42 | 3.42 s | OK |
| 72 | PostgreSQL | q3 | 1200 | 6.817 | 6.82 s | OK |
| 73 | PostgreSQL | q3 | 6000 | 35.495 | 35 s | OK |
| 74 | PostgreSQL | q4 | 600 | 10.715 | 11 s | OK |
| 75 | PostgreSQL | q4 | 1200 | 21.209 | 21 s | OK |
| 76 | PostgreSQL | q4 | 6000 | 105.162 | 105 s | OK |
| 77 | PostgreSQL | q5 | 600 | 222.111 | 3.7 min | OK |
| 78 | PostgreSQL | q5 | 1200 | 444.001 | 7.4 min | OK |
| 79 | PostgreSQL | q5 | 6000 | 2219.125 | 37.0 min | OK |
| 80 | PostgreSQL | q6 | 600 | 4.06 | 4.06 s | OK |
| 81 | PostgreSQL | q6 | 1200 | 8.137 | 8.14 s | OK |
| 82 | PostgreSQL | q6 | 6000 | 42.55 | 43 s | OK |
| 83 | PostgreSQL | q7 | 600 | 114.849 | 115 s | OK |
| 84 | PostgreSQL | q7 | 1200 | 229.477 | 3.8 min | OK |
| 85 | PostgreSQL | q7 | 6000 | 1146.503 | 19.1 min | OK |
| 86 | RDF triplestore | q1 | 600 | 0.113 | 0.11 s | OK |
| 87 | RDF triplestore | q1 | 1200 | 0.113 | 0.11 s | OK |
| 88 | RDF triplestore | q1 | 6000 | 0.113 | 0.11 s | OK |
| 89 | RDF triplestore | q2 | 600 | 10866.789 | 3.0 h | IMPRACTICAL |
| 90 | RDF triplestore | q2 | 1200 | 21733.465 | 6.0 h | IMPRACTICAL |
| 91 | RDF triplestore | q2 | 6000 | 108666.874 | 30.2 h | FAIL |
| 92 | RDF triplestore | q3 | 600 | 185722.881 | 2.1 d | FAIL |
| 93 | RDF triplestore | q3 | 1200 | 371445.649 | 4.3 d | FAIL |
| 94 | RDF triplestore | q3 | 6000 | 1857227.792 | 21.5 d | FAIL |
| 95 | RDF triplestore | q4 | 600 | 79559.375 | 22.1 h | IMPRACTICAL |
| 96 | RDF triplestore | q4 | 1200 | 159118.636 | 44.2 h | FAIL |
| 97 | RDF triplestore | q4 | 6000 | 795592.727 | 9.2 d | FAIL |
| 98 | RDF triplestore | q5 | 600 | 240054.647 | 2.8 d | FAIL |
| 99 | RDF triplestore | q5 | 1200 | 480109.181 | 5.6 d | FAIL |
| 100 | RDF triplestore | q5 | 6000 | 2400545.453 | 27.8 d | FAIL |
| 101 | RDF triplestore | q6 | 600 | 352.729 | 5.9 min | OK |
| 102 | RDF triplestore | q6 | 1200 | 727.088 | 12.1 min | OK |
| 103 | RDF triplestore | q6 | 6000 | 3887.402 | 64.8 min | IMPRACTICAL |
| 104 | RDF triplestore | q7 | 600 | 163225.475 | 45.3 h | FAIL |
| 105 | RDF triplestore | q7 | 1200 | 326450.837 | 3.8 d | FAIL |
| 106 | RDF triplestore | q7 | 6000 | 1632253.733 | 18.9 d | FAIL |