Public/LabDataStorageEvaluation
1
0
Fork 0
Code Issues Pull Requests Actions Releases Wiki Activity

feat(docs): add management summary link in evaluation documents

Browse Source 
- include link to one-page executive summary in README
- update dashboard section in evaluation HTML to reference summary
- revise report metadata to reflect additional CSV tables generated
This commit is contained in:
administrator
2026-07-13 00:19:02 -04:00
parent 478d4f3201
commit 6d156f98c4
8 changed files with 538 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

106
out/report/tables/t6_projected_all_scales.csv Normal file
View File

@@ -0,0 +1,106 @@
format,query,scale_gb,projected_wall_s,projected_wall,flag
CSV,q1,600,0.06,0.06 s,OK
CSV,q1,1200,0.06,0.06 s,OK
CSV,q1,6000,0.06,0.06 s,OK
CSV,q2,600,428.301,7.1 min,OK
CSV,q2,1200,856.543,14.3 min,OK
CSV,q2,6000,4282.474,71.4 min,IMPRACTICAL
CSV,q3,600,4408.0,73.5 min,IMPRACTICAL
CSV,q3,1200,8815.94,2.4 h,IMPRACTICAL
CSV,q3,6000,44079.46,12.2 h,IMPRACTICAL
CSV,q4,600,2643.775,44.1 min,OK
CSV,q4,1200,5287.489,88.1 min,IMPRACTICAL
CSV,q4,6000,26437.206,7.3 h,IMPRACTICAL
CSV,q5,600,4176.725,69.6 min,IMPRACTICAL
CSV,q5,1200,8353.391,2.3 h,IMPRACTICAL
CSV,q5,6000,41766.715,11.6 h,IMPRACTICAL
CSV,q6,600,870.266,14.5 min,OK
CSV,q6,1200,1740.472,29.0 min,OK
CSV,q6,6000,8702.119,2.4 h,IMPRACTICAL
CSV,q7,600,4897.995,81.6 min,IMPRACTICAL
CSV,q7,1200,9795.931,2.7 h,IMPRACTICAL
CSV,q7,6000,48979.414,13.6 h,IMPRACTICAL
JSON-LD,q1,600,0.111,0.11 s,OK
JSON-LD,q1,1200,0.111,0.11 s,OK
JSON-LD,q1,6000,0.111,0.11 s,OK
JSON-LD,q2,600,5519.622,92.0 min,IMPRACTICAL
JSON-LD,q2,1200,11039.133,3.1 h,IMPRACTICAL
JSON-LD,q2,6000,55195.222,15.3 h,IMPRACTICAL
JSON-LD,q3,600,39673.993,11.0 h,IMPRACTICAL
JSON-LD,q3,1200,79347.876,22.0 h,IMPRACTICAL
JSON-LD,q3,6000,396738.933,4.6 d,FAIL
JSON-LD,q4,600,39597.306,11.0 h,IMPRACTICAL
JSON-LD,q4,1200,79194.5,22.0 h,IMPRACTICAL
JSON-LD,q4,6000,395972.054,4.6 d,FAIL
JSON-LD,q5,600,39760.772,11.0 h,IMPRACTICAL
JSON-LD,q5,1200,79521.432,22.1 h,IMPRACTICAL
JSON-LD,q5,6000,397606.717,4.6 d,FAIL
JSON-LD,q6,600,39076.231,10.9 h,IMPRACTICAL
JSON-LD,q6,1200,78152.351,21.7 h,IMPRACTICAL
JSON-LD,q6,6000,390761.312,4.5 d,FAIL
JSON-LD,q7,600,40228.164,11.2 h,IMPRACTICAL
JSON-LD,q7,1200,80456.218,22.3 h,IMPRACTICAL
JSON-LD,q7,6000,402280.643,4.7 d,FAIL
SQLite,q1,600,0.062,0.06 s,OK
SQLite,q1,1200,0.063,0.06 s,OK
SQLite,q1,6000,0.063,0.06 s,OK
SQLite,q2,600,1.271,1.27 s,OK
SQLite,q2,1200,2.482,2.48 s,OK
SQLite,q2,6000,12.169,12 s,OK
SQLite,q3,600,339.238,5.7 min,OK
SQLite,q3,1200,699.328,11.7 min,OK
SQLite,q3,6000,3739.195,62.3 min,IMPRACTICAL
SQLite,q4,600,0.06,0.06 s,OK
SQLite,q4,1200,0.06,0.06 s,OK
SQLite,q4,6000,0.06,0.06 s,OK
SQLite,q5,600,2847.603,47.5 min,OK
SQLite,q5,1200,5695.146,94.9 min,IMPRACTICAL
SQLite,q5,6000,28475.49,7.9 h,IMPRACTICAL
SQLite,q6,600,5.18,5.18 s,OK
SQLite,q6,1200,10.615,11 s,OK
SQLite,q6,6000,56.5,56 s,OK
SQLite,q7,600,2619.558,43.7 min,OK
SQLite,q7,1200,5239.055,87.3 min,IMPRACTICAL
SQLite,q7,6000,26195.034,7.3 h,IMPRACTICAL
PostgreSQL,q1,600,0.222,0.22 s,OK
PostgreSQL,q1,1200,0.222,0.22 s,OK
PostgreSQL,q1,6000,0.222,0.22 s,OK
PostgreSQL,q2,600,0.221,0.22 s,OK
PostgreSQL,q2,1200,0.221,0.22 s,OK
PostgreSQL,q2,6000,0.221,0.22 s,OK
PostgreSQL,q3,600,3.42,3.42 s,OK
PostgreSQL,q3,1200,6.817,6.82 s,OK
PostgreSQL,q3,6000,35.495,35 s,OK
PostgreSQL,q4,600,10.715,11 s,OK
PostgreSQL,q4,1200,21.209,21 s,OK
PostgreSQL,q4,6000,105.162,105 s,OK
PostgreSQL,q5,600,222.111,3.7 min,OK
PostgreSQL,q5,1200,444.001,7.4 min,OK
PostgreSQL,q5,6000,2219.125,37.0 min,OK
PostgreSQL,q6,600,4.06,4.06 s,OK
PostgreSQL,q6,1200,8.137,8.14 s,OK
PostgreSQL,q6,6000,42.55,43 s,OK
PostgreSQL,q7,600,114.849,115 s,OK
PostgreSQL,q7,1200,229.477,3.8 min,OK
PostgreSQL,q7,6000,1146.503,19.1 min,OK
RDF triplestore,q1,600,0.113,0.11 s,OK
RDF triplestore,q1,1200,0.113,0.11 s,OK
RDF triplestore,q1,6000,0.113,0.11 s,OK
RDF triplestore,q2,600,10866.789,3.0 h,IMPRACTICAL
RDF triplestore,q2,1200,21733.465,6.0 h,IMPRACTICAL
RDF triplestore,q2,6000,108666.874,30.2 h,FAIL
RDF triplestore,q3,600,185722.881,2.1 d,FAIL
RDF triplestore,q3,1200,371445.649,4.3 d,FAIL
RDF triplestore,q3,6000,1857227.792,21.5 d,FAIL
RDF triplestore,q4,600,79559.375,22.1 h,IMPRACTICAL
RDF triplestore,q4,1200,159118.636,44.2 h,FAIL
RDF triplestore,q4,6000,795592.727,9.2 d,FAIL
RDF triplestore,q5,600,240054.647,2.8 d,FAIL
RDF triplestore,q5,1200,480109.181,5.6 d,FAIL
RDF triplestore,q5,6000,2400545.453,27.8 d,FAIL
RDF triplestore,q6,600,352.729,5.9 min,OK
RDF triplestore,q6,1200,727.088,12.1 min,OK
RDF triplestore,q6,6000,3887.402,64.8 min,IMPRACTICAL
RDF triplestore,q7,600,163225.475,45.3 h,FAIL
RDF triplestore,q7,1200,326450.837,3.8 d,FAIL
RDF triplestore,q7,6000,1632253.733,18.9 d,FAIL
1 format query scale_gb projected_wall_s projected_wall flag
2 CSV q1 600 0.06 0.06 s OK
3 CSV q1 1200 0.06 0.06 s OK
4 CSV q1 6000 0.06 0.06 s OK
5 CSV q2 600 428.301 7.1 min OK
6 CSV q2 1200 856.543 14.3 min OK
7 CSV q2 6000 4282.474 71.4 min IMPRACTICAL
8 CSV q3 600 4408.0 73.5 min IMPRACTICAL
9 CSV q3 1200 8815.94 2.4 h IMPRACTICAL
10 CSV q3 6000 44079.46 12.2 h IMPRACTICAL
11 CSV q4 600 2643.775 44.1 min OK
12 CSV q4 1200 5287.489 88.1 min IMPRACTICAL
13 CSV q4 6000 26437.206 7.3 h IMPRACTICAL
14 CSV q5 600 4176.725 69.6 min IMPRACTICAL
15 CSV q5 1200 8353.391 2.3 h IMPRACTICAL
16 CSV q5 6000 41766.715 11.6 h IMPRACTICAL
17 CSV q6 600 870.266 14.5 min OK
18 CSV q6 1200 1740.472 29.0 min OK
19 CSV q6 6000 8702.119 2.4 h IMPRACTICAL
20 CSV q7 600 4897.995 81.6 min IMPRACTICAL
21 CSV q7 1200 9795.931 2.7 h IMPRACTICAL
22 CSV q7 6000 48979.414 13.6 h IMPRACTICAL
23 JSON-LD q1 600 0.111 0.11 s OK
24 JSON-LD q1 1200 0.111 0.11 s OK
25 JSON-LD q1 6000 0.111 0.11 s OK
26 JSON-LD q2 600 5519.622 92.0 min IMPRACTICAL
27 JSON-LD q2 1200 11039.133 3.1 h IMPRACTICAL
28 JSON-LD q2 6000 55195.222 15.3 h IMPRACTICAL
29 JSON-LD q3 600 39673.993 11.0 h IMPRACTICAL
30 JSON-LD q3 1200 79347.876 22.0 h IMPRACTICAL
31 JSON-LD q3 6000 396738.933 4.6 d FAIL
32 JSON-LD q4 600 39597.306 11.0 h IMPRACTICAL
33 JSON-LD q4 1200 79194.5 22.0 h IMPRACTICAL
34 JSON-LD q4 6000 395972.054 4.6 d FAIL
35 JSON-LD q5 600 39760.772 11.0 h IMPRACTICAL
36 JSON-LD q5 1200 79521.432 22.1 h IMPRACTICAL
37 JSON-LD q5 6000 397606.717 4.6 d FAIL
38 JSON-LD q6 600 39076.231 10.9 h IMPRACTICAL
39 JSON-LD q6 1200 78152.351 21.7 h IMPRACTICAL
40 JSON-LD q6 6000 390761.312 4.5 d FAIL
41 JSON-LD q7 600 40228.164 11.2 h IMPRACTICAL
42 JSON-LD q7 1200 80456.218 22.3 h IMPRACTICAL
43 JSON-LD q7 6000 402280.643 4.7 d FAIL
44 SQLite q1 600 0.062 0.06 s OK
45 SQLite q1 1200 0.063 0.06 s OK
46 SQLite q1 6000 0.063 0.06 s OK
47 SQLite q2 600 1.271 1.27 s OK
48 SQLite q2 1200 2.482 2.48 s OK
49 SQLite q2 6000 12.169 12 s OK
50 SQLite q3 600 339.238 5.7 min OK
51 SQLite q3 1200 699.328 11.7 min OK
52 SQLite q3 6000 3739.195 62.3 min IMPRACTICAL
53 SQLite q4 600 0.06 0.06 s OK
54 SQLite q4 1200 0.06 0.06 s OK
55 SQLite q4 6000 0.06 0.06 s OK
56 SQLite q5 600 2847.603 47.5 min OK
57 SQLite q5 1200 5695.146 94.9 min IMPRACTICAL
58 SQLite q5 6000 28475.49 7.9 h IMPRACTICAL
59 SQLite q6 600 5.18 5.18 s OK
60 SQLite q6 1200 10.615 11 s OK
61 SQLite q6 6000 56.5 56 s OK
62 SQLite q7 600 2619.558 43.7 min OK
63 SQLite q7 1200 5239.055 87.3 min IMPRACTICAL
64 SQLite q7 6000 26195.034 7.3 h IMPRACTICAL
65 PostgreSQL q1 600 0.222 0.22 s OK
66 PostgreSQL q1 1200 0.222 0.22 s OK
67 PostgreSQL q1 6000 0.222 0.22 s OK
68 PostgreSQL q2 600 0.221 0.22 s OK
69 PostgreSQL q2 1200 0.221 0.22 s OK
70 PostgreSQL q2 6000 0.221 0.22 s OK
71 PostgreSQL q3 600 3.42 3.42 s OK
72 PostgreSQL q3 1200 6.817 6.82 s OK
73 PostgreSQL q3 6000 35.495 35 s OK
74 PostgreSQL q4 600 10.715 11 s OK
75 PostgreSQL q4 1200 21.209 21 s OK
76 PostgreSQL q4 6000 105.162 105 s OK
77 PostgreSQL q5 600 222.111 3.7 min OK
78 PostgreSQL q5 1200 444.001 7.4 min OK
79 PostgreSQL q5 6000 2219.125 37.0 min OK
80 PostgreSQL q6 600 4.06 4.06 s OK
81 PostgreSQL q6 1200 8.137 8.14 s OK
82 PostgreSQL q6 6000 42.55 43 s OK
83 PostgreSQL q7 600 114.849 115 s OK
84 PostgreSQL q7 1200 229.477 3.8 min OK
85 PostgreSQL q7 6000 1146.503 19.1 min OK
86 RDF triplestore q1 600 0.113 0.11 s OK
87 RDF triplestore q1 1200 0.113 0.11 s OK
88 RDF triplestore q1 6000 0.113 0.11 s OK
89 RDF triplestore q2 600 10866.789 3.0 h IMPRACTICAL
90 RDF triplestore q2 1200 21733.465 6.0 h IMPRACTICAL
91 RDF triplestore q2 6000 108666.874 30.2 h FAIL
92 RDF triplestore q3 600 185722.881 2.1 d FAIL
93 RDF triplestore q3 1200 371445.649 4.3 d FAIL
94 RDF triplestore q3 6000 1857227.792 21.5 d FAIL
95 RDF triplestore q4 600 79559.375 22.1 h IMPRACTICAL
96 RDF triplestore q4 1200 159118.636 44.2 h FAIL
97 RDF triplestore q4 6000 795592.727 9.2 d FAIL
98 RDF triplestore q5 600 240054.647 2.8 d FAIL
99 RDF triplestore q5 1200 480109.181 5.6 d FAIL
100 RDF triplestore q5 6000 2400545.453 27.8 d FAIL
101 RDF triplestore q6 600 352.729 5.9 min OK
102 RDF triplestore q6 1200 727.088 12.1 min OK
103 RDF triplestore q6 6000 3887.402 64.8 min IMPRACTICAL
104 RDF triplestore q7 600 163225.475 45.3 h FAIL
105 RDF triplestore q7 1200 326450.837 3.8 d FAIL
106 RDF triplestore q7 6000 1632253.733 18.9 d FAIL

16
out/report/tables/t7_hardware_all_scales.csv Normal file
View File

@@ -0,0 +1,16 @@
format,scale_gb,configuration,disk_tb,ram_gb,cores,nodes,ram_modules,nvme_drives,base_usd,ram_usd,disk_usd,extra_nodes_usd,est_cost_usd
CSV,600,1 x 1U Supermicro AS-1015CS-TNR (16 cores); 1 x 64 GB DDR5 ECC RDIMM; 1 x 7.68 TB NVMe U.2,0.78,16.0,16,1,1,1,4618,1887,3995,0,10500
CSV,1200,1 x 1U Supermicro AS-1015CS-TNR (16 cores); 1 x 64 GB DDR5 ECC RDIMM; 1 x 7.68 TB NVMe U.2,1.56,16.0,16,1,1,1,4618,1887,3995,0,10500
CSV,6000,1 x 1U Supermicro AS-1015CS-TNR (16 cores); 1 x 64 GB DDR5 ECC RDIMM; 2 x 7.68 TB NVMe U.2,7.8,16.0,16,1,1,2,4618,1887,7990,0,14495
JSON-LD,600,1 x 1U Supermicro AS-1015CS-TNR (16 cores); 1 x 64 GB DDR5 ECC RDIMM; 1 x 7.68 TB NVMe U.2,1.633,16.0,16,1,1,1,4618,1887,3995,0,10500
JSON-LD,1200,1 x 1U Supermicro AS-1015CS-TNR (16 cores); 1 x 64 GB DDR5 ECC RDIMM; 1 x 7.68 TB NVMe U.2,3.267,16.0,16,1,1,1,4618,1887,3995,0,10500
JSON-LD,6000,1 x 1U Supermicro AS-1015CS-TNR (16 cores); 1 x 64 GB DDR5 ECC RDIMM; 3 x 7.68 TB NVMe U.2,16.334,16.0,16,1,1,3,4618,1887,11985,0,18490
SQLite,600,1 x 1U Supermicro AS-1015CS-TNR (16 cores); 1 x 64 GB DDR5 ECC RDIMM; 1 x 7.68 TB NVMe U.2,0.647,21.0,16,1,1,1,4618,1887,3995,0,10500
SQLite,1200,1 x 1U Supermicro AS-1015CS-TNR (16 cores); 1 x 64 GB DDR5 ECC RDIMM; 1 x 7.68 TB NVMe U.2,1.295,38.0,16,1,1,1,4618,1887,3995,0,10500
SQLite,6000,1 x 1U Supermicro AS-1015CS-TNR (16 cores); 3 x 64 GB DDR5 ECC RDIMM; 1 x 7.68 TB NVMe U.2,6.475,173.9,16,1,3,1,4618,5661,3995,0,14274
PostgreSQL,600,1 x 1U Supermicro AS-1015CS-TNR (16 cores); 1 x 64 GB DDR5 ECC RDIMM; 1 x 7.68 TB NVMe U.2,2.086,58.7,16,1,1,1,4618,1887,3995,0,10500
PostgreSQL,1200,1 x 1U Supermicro AS-1015CS-TNR (16 cores); 2 x 64 GB DDR5 ECC RDIMM; 1 x 7.68 TB NVMe U.2,4.171,113.5,16,1,2,1,4618,3774,3995,0,12387
PostgreSQL,6000,1 x 1U Supermicro AS-1015CS-TNR (16 cores); 9 x 64 GB DDR5 ECC RDIMM; 3 x 7.68 TB NVMe U.2,20.855,551.3,16,1,9,3,4618,16983,11985,0,33586
RDF triplestore,600,2 x 1U Supermicro AS-1015CS-TNR (16 cores); 22 x 64 GB DDR5 ECC RDIMM; 2 x 7.68 TB NVMe U.2,9.127,1404.1,16,2,22,2,4618,41514,7990,4618,58740
RDF triplestore,1200,3 x 1U Supermicro AS-1015CS-TNR (16 cores); 44 x 64 GB DDR5 ECC RDIMM; 3 x 7.68 TB NVMe U.2,18.254,2808.3,16,3,44,3,4618,83028,11985,9236,108867
RDF triplestore,6000,14 x 1U Supermicro AS-1015CS-TNR (16 cores); 220 x 64 GB DDR5 ECC RDIMM; 12 x 7.68 TB NVMe U.2,91.268,14041.3,16,14,220,12,4618,415140,47940,60034,527732
1 format scale_gb configuration disk_tb ram_gb cores nodes ram_modules nvme_drives base_usd ram_usd disk_usd extra_nodes_usd est_cost_usd
2 CSV 600 1 x 1U Supermicro AS-1015CS-TNR (16 cores); 1 x 64 GB DDR5 ECC RDIMM; 1 x 7.68 TB NVMe U.2 0.78 16.0 16 1 1 1 4618 1887 3995 0 10500
3 CSV 1200 1 x 1U Supermicro AS-1015CS-TNR (16 cores); 1 x 64 GB DDR5 ECC RDIMM; 1 x 7.68 TB NVMe U.2 1.56 16.0 16 1 1 1 4618 1887 3995 0 10500
4 CSV 6000 1 x 1U Supermicro AS-1015CS-TNR (16 cores); 1 x 64 GB DDR5 ECC RDIMM; 2 x 7.68 TB NVMe U.2 7.8 16.0 16 1 1 2 4618 1887 7990 0 14495
5 JSON-LD 600 1 x 1U Supermicro AS-1015CS-TNR (16 cores); 1 x 64 GB DDR5 ECC RDIMM; 1 x 7.68 TB NVMe U.2 1.633 16.0 16 1 1 1 4618 1887 3995 0 10500
6 JSON-LD 1200 1 x 1U Supermicro AS-1015CS-TNR (16 cores); 1 x 64 GB DDR5 ECC RDIMM; 1 x 7.68 TB NVMe U.2 3.267 16.0 16 1 1 1 4618 1887 3995 0 10500
7 JSON-LD 6000 1 x 1U Supermicro AS-1015CS-TNR (16 cores); 1 x 64 GB DDR5 ECC RDIMM; 3 x 7.68 TB NVMe U.2 16.334 16.0 16 1 1 3 4618 1887 11985 0 18490
8 SQLite 600 1 x 1U Supermicro AS-1015CS-TNR (16 cores); 1 x 64 GB DDR5 ECC RDIMM; 1 x 7.68 TB NVMe U.2 0.647 21.0 16 1 1 1 4618 1887 3995 0 10500
9 SQLite 1200 1 x 1U Supermicro AS-1015CS-TNR (16 cores); 1 x 64 GB DDR5 ECC RDIMM; 1 x 7.68 TB NVMe U.2 1.295 38.0 16 1 1 1 4618 1887 3995 0 10500
10 SQLite 6000 1 x 1U Supermicro AS-1015CS-TNR (16 cores); 3 x 64 GB DDR5 ECC RDIMM; 1 x 7.68 TB NVMe U.2 6.475 173.9 16 1 3 1 4618 5661 3995 0 14274
11 PostgreSQL 600 1 x 1U Supermicro AS-1015CS-TNR (16 cores); 1 x 64 GB DDR5 ECC RDIMM; 1 x 7.68 TB NVMe U.2 2.086 58.7 16 1 1 1 4618 1887 3995 0 10500
12 PostgreSQL 1200 1 x 1U Supermicro AS-1015CS-TNR (16 cores); 2 x 64 GB DDR5 ECC RDIMM; 1 x 7.68 TB NVMe U.2 4.171 113.5 16 1 2 1 4618 3774 3995 0 12387
13 PostgreSQL 6000 1 x 1U Supermicro AS-1015CS-TNR (16 cores); 9 x 64 GB DDR5 ECC RDIMM; 3 x 7.68 TB NVMe U.2 20.855 551.3 16 1 9 3 4618 16983 11985 0 33586
14 RDF triplestore 600 2 x 1U Supermicro AS-1015CS-TNR (16 cores); 22 x 64 GB DDR5 ECC RDIMM; 2 x 7.68 TB NVMe U.2 9.127 1404.1 16 2 22 2 4618 41514 7990 4618 58740
15 RDF triplestore 1200 3 x 1U Supermicro AS-1015CS-TNR (16 cores); 44 x 64 GB DDR5 ECC RDIMM; 3 x 7.68 TB NVMe U.2 18.254 2808.3 16 3 44 3 4618 83028 11985 9236 108867
16 RDF triplestore 6000 14 x 1U Supermicro AS-1015CS-TNR (16 cores); 220 x 64 GB DDR5 ECC RDIMM; 12 x 7.68 TB NVMe U.2 91.268 14041.3 16 14 220 12 4618 415140 47940 60034 527732