Skip to content

Commit

Permalink
Update
Browse files Browse the repository at this point in the history 
Signed-off-by: Lehmann_Fabian <[email protected]>
  • Loading branch information
@Lehmann-Fabian
Lehmann-Fabian committed Apr 29, 2024
1 parent fb5e448 commit d554aa8
Show file tree
Hide file tree
Showing 59 changed files with 161 additions and 240 deletions.
337 changes: 129 additions & 208 deletions evaluation.ipynb
View file

Large diffs are not rendered by default.

32 changes: 16 additions & 16 deletions evaluation/results1Gbit.csv
View file
Original file line number Diff line number Diff line change
@@ -1,17 +1,17 @@
workflow;Makespan in m (Orig Ceph);Improvement over Orig (CWS Ceph);Improvement over Orig (WOW Ceph);CPU hours used (Orig Ceph);Improvement over Orig (CWS Ceph);Improvement over Orig (WOW Ceph);CPU hours allocated (Orig Ceph);Improvement over Orig (CWS Ceph);Improvement over Orig (WOW Ceph);Not copied (Ceph);Useless copies (Ceph);Makespan in m (Orig NFS);Improvement over Orig (CWS NFS);Improvement over Orig (WOW NFS);CPU hours used (Orig NFS);Improvement over Orig (CWS NFS);Improvement over Orig (WOW NFS);CPU hours allocated (Orig NFS);Improvement over Orig (CWS NFS);Improvement over Orig (WOW NFS);Not copied (NFS);Useless copies (NFS)
RNA-Seq;181.128;-6.087;-18.343;230.000;2.622;2.582;474.356;7.852;-13.579;90.071;28.810;413.006;-2.558;-53.227;247.680;4.939;-2.627;1354.647;12.358;-60.810;89.125;22.924
Sarek;304.991;-6.954;-4.219;618.988;1.151;0.457;997.887;1.160;-4.080;85.975;40.419;557.459;-1.338;-42.647;631.365;1.759;-0.886;1806.054;-0.441;-40.417;85.779;39.126
Chip-Seq;221.115;4.863;-15.357;505.441;2.419;1.639;710.291;7.113;-5.975;79.644;18.596;375.038;9.558;-44.752;486.984;4.837;6.062;1293.776;15.697;-42.252;78.880;17.731
Rangeland;165.990;-1.950;-4.317;338.447;0.244;-0.939;468.316;0.055;-2.087;88.662;60.672;181.198;-0.702;-13.353;335.646;0.677;0.603;476.214;0.675;-2.789;88.662;64.349
Syn. BLAST;34.954;0.521;-41.590;0.617;-0.061;-6.789;1.457;-12.873;-51.275;98.990;18.182;55.638;0.738;-60.758;0.609;3.986;-6.406;3.933;-6.236;-62.588;98.990;18.182
Syn. BWA;37.744;-0.978;-61.122;1.965;-1.976;-70.293;11.999;-0.616;-78.787;100.000;0.000;81.703;1.194;-82.727;2.136;-0.864;-71.995;65.728;-0.853;-96.027;100.000;0.000
Syn. Cycles;20.002;3.640;-47.891;0.410;-0.311;-7.350;9.199;-4.154;-78.430;89.899;51.111;55.627;-2.833;-81.325;0.430;0.859;-12.260;30.871;-6.874;-91.346;89.394;48.837
Syn. Genome;28.587;-4.671;-61.992;0.703;1.527;-23.509;22.794;0.537;-88.681;92.929;53.846;92.909;0.743;-86.341;0.689;-0.721;-27.341;100.156;3.274;-95.009;92.929;47.826
Syn. Montage;31.404;-2.842;-44.647;0.502;-0.513;-15.642;7.395;13.213;-88.785;61.616;74.038;85.849;-2.030;-78.653;0.528;0.076;-18.912;27.189;6.823;-93.010;61.111;72.642
Syn. Seismology;31.383;0.762;-20.926;0.597;-0.256;-2.435;1.500;-15.930;-42.640;99.495;50.000;45.511;0.510;-47.395;0.594;3.797;-3.448;2.400;-1.588;-35.496;99.495;50.000
Syn. Soykb;31.608;-4.040;-56.927;0.423;-0.723;-12.611;7.912;13.167;-74.823;91.837;58.537;65.742;-1.396;-72.918;0.442;0.164;-20.059;29.339;-3.300;-92.565;87.755;53.333
All in One;32.469;-2.803;-49.304;0.072;-6.351;-4.412;2.455;-5.182;-69.142;99.010;50.000;40.622;0.100;-60.099;0.078;3.718;-10.530;2.684;2.540;-71.370;99.010;50.000
Chain;16.157;2.766;-86.388;0.282;6.133;-42.476;40.290;-13.403;-95.970;98.500;5.128;38.464;4.985;-94.459;0.298;-0.327;-44.642;112.549;-35.448;-98.554;99.000;5.263
Fork;9.628;-18.458;-76.626;0.232;-20.918;-35.516;14.681;-70.209;-89.577;99.010;14.286;18.156;-1.614;-88.433;0.223;-0.424;-32.429;30.209;-8.262;-95.033;99.010;14.286
Group;14.150;-3.873;-78.275;0.063;-1.915;-30.328;14.171;4.621;-96.837;76.119;86.842;34.522;-3.266;-90.449;0.074;-0.688;-39.424;51.005;-2.825;-99.148;75.373;80.488
Group Multiple;21.342;-0.911;-80.089;0.093;-2.898;-33.052;35.597;-5.635;-98.246;71.250;92.593;49.709;0.328;-90.747;0.114;-0.486;-44.777;98.644;2.762;-99.375;68.125;86.207
\multirow{4}{*}{\cellcolor{white}\rotatebox{90}{Real-World}};RNA-Seq;181.128;-6.087;-18.343;230.000;2.622;2.582;474.356;7.852;-13.579;90.071;28.810;413.006;-2.558;-53.227;247.680;4.939;-2.627;1354.647;12.358;-60.810;89.125;22.924
;Sarek;304.991;-6.954;-4.219;618.988;1.151;0.457;997.887;1.160;-4.080;85.975;40.419;557.459;-1.338;-42.647;631.365;1.759;-0.886;1806.054;-0.441;-40.417;85.779;39.126
;Chip-Seq;221.115;4.863;-15.357;505.441;2.419;1.639;710.291;7.113;-5.975;79.644;18.596;375.038;9.558;-44.752;486.984;4.837;6.062;1293.776;15.697;-42.252;78.880;17.731
;Rangeland;165.990;-1.950;-4.317;338.447;0.244;-0.939;468.316;0.055;-2.087;88.662;60.672;181.198;-0.702;-13.353;335.646;0.677;0.603;476.214;0.675;-2.789;88.662;64.349
\multirow{7}{*}{\cellcolor{white}\rotatebox{90}{Synthetic}};Syn. BLAST;34.954;0.521;-41.590;0.617;-0.061;-6.789;1.457;-12.873;-51.275;98.990;18.182;55.638;0.738;-60.758;0.609;3.986;-6.406;3.933;-6.236;-62.588;98.990;18.182
;Syn. BWA;37.744;-0.978;-61.122;1.965;-1.976;-70.293;11.999;-0.616;-78.787;100.000;0.000;81.703;1.194;-82.727;2.136;-0.864;-71.995;65.728;-0.853;-96.027;100.000;0.000
;Syn. Cycles;20.002;3.640;-47.891;0.410;-0.311;-7.350;9.199;-4.154;-78.430;89.899;51.111;55.627;-2.833;-81.325;0.430;0.859;-12.260;30.871;-6.874;-91.346;89.394;48.837
;Syn. Genome;28.587;-4.671;-61.992;0.703;1.527;-23.509;22.794;0.537;-88.681;92.929;53.846;92.909;0.743;-86.341;0.689;-0.721;-27.341;100.156;3.274;-95.009;92.929;47.826
;Syn. Montage;31.404;-2.842;-44.647;0.502;-0.513;-15.642;7.395;13.213;-88.785;61.616;74.038;85.849;-2.030;-78.653;0.528;0.076;-18.912;27.189;6.823;-93.010;61.111;72.642
;Syn. Seismology;31.383;0.762;-20.926;0.597;-0.256;-2.435;1.500;-15.930;-42.640;99.495;50.000;45.511;0.510;-47.395;0.594;3.797;-3.448;2.400;-1.588;-35.496;99.495;50.000
;Syn. Soykb;31.608;-4.040;-56.927;0.423;-0.723;-12.611;7.912;13.167;-74.823;91.837;58.537;65.742;-1.396;-72.918;0.442;0.164;-20.059;29.339;-3.300;-92.565;87.755;53.333
\multirow{5}{*}{\cellcolor{white}\rotatebox{90}{Pattern}};All in One;32.469;-2.803;-49.304;0.072;-6.351;-4.412;2.455;-5.182;-69.142;99.010;50.000;40.622;0.100;-60.099;0.078;3.718;-10.530;2.684;2.540;-71.370;99.010;50.000
;Chain;16.157;2.766;-86.388;0.282;6.133;-42.476;40.290;-13.403;-95.970;98.500;5.128;38.464;4.985;-94.459;0.298;-0.327;-44.642;112.549;-35.448;-98.554;99.000;5.263
;Fork;9.628;-18.458;-76.626;0.232;-20.918;-35.516;14.681;-70.209;-89.577;99.010;14.286;18.156;-1.614;-88.433;0.223;-0.424;-32.429;30.209;-8.262;-95.033;99.010;14.286
;Group;14.150;-3.873;-78.275;0.063;-1.915;-30.328;14.171;4.621;-96.837;76.119;86.842;34.522;-3.266;-90.449;0.074;-0.688;-39.424;51.005;-2.825;-99.148;75.373;80.488
;Group Multiple;21.342;-0.911;-80.089;0.093;-2.898;-33.052;35.597;-5.635;-98.246;71.250;92.593;49.709;0.328;-90.747;0.114;-0.486;-44.777;98.644;2.762;-99.375;68.125;86.207
32 changes: 16 additions & 16 deletions evaluation/workflowInputs.csv
View file
Original file line number Diff line number Diff line change
@@ -1,17 +1,17 @@
Workflow;Inputs in GB;Generated GB;Factor;Abstract tasks;Physical tasks
RNA-Seq;139.143;598.288;4.300;53;1,269
Sarek;205.863;918.845;4.463;49;8,656
Chip-Seq;141.224;787.196;5.574;48;3,537
Rangeland;303.218;273.996;0.904;8;3,184
Syn. BLAST;21.859;151.032;6.909;4;198
Syn. BWA;19.450;152.823;7.857;5;198
Syn. Cycles;20.442;157.893;7.724;7;198
Syn. Genome;21.897;154.734;7.067;5;198
Syn. Montage;19.785;168.804;8.532;8;198
Syn. Seismology;20.654;150.698;7.296;2;198
Syn. Soykb;22.271;159.975;7.183;14;196
All in One;0.000;180.327;-;2;101
Chain;0.000;180.330;-;2;200
Fork;0.000;99.425;-;2;101
Group;0.000;180.328;-;2;134
Group Multiple;0.000;270.491;-;3;160
\multirow{4}{*}{\cellcolor{white}\rotatebox{90}{Real-World}};RNA-Seq;139.143;598.288;4.300;53;1,269
;Sarek;205.863;918.845;4.463;49;8,656
;Chip-Seq;141.224;787.196;5.574;48;3,537
;Rangeland;303.218;273.996;0.904;8;3,184
\multirow{7}{*}{\cellcolor{white}\rotatebox{90}{Synthetic}};Syn. BLAST;21.859;151.032;6.909;4;198
;Syn. BWA;19.450;152.823;7.857;5;198
;Syn. Cycles;20.442;157.893;7.724;7;198
;Syn. Genome;21.897;154.734;7.067;5;198
;Syn. Montage;19.785;168.804;8.532;8;198
;Syn. Seismology;20.654;150.698;7.296;2;198
;Syn. Soykb;22.271;159.975;7.183;14;196
\multirow{5}{*}{\cellcolor{white}\rotatebox{90}{Pattern}};All in One;0.000;180.327;-;2;101
;Chain;0.000;180.330;-;2;200
;Fork;0.000;99.425;-;2;101
;Group;0.000;180.328;-;2;134
;Group Multiple;0.000;270.491;-;3;160
Binary file modified plots/Cluster_Speed_avgTransferSpeed.pdf
View file
Binary file not shown.
Binary file modified plots/Gini_Coefficient_cpuHoursByNode.pdf
View file
Binary file not shown.
Binary file modified plots/Gini_Coefficient_localData.pdf
View file
Binary file not shown.
Binary file modified plots/Gini_Coefficient_tasksByNode.pdf
View file
Binary file not shown.
Binary file modified plots/data_generation_overhead.pdf
View file
Binary file not shown.
Binary file modified plots/data_generation_overhead_inverted.pdf
View file
Binary file not shown.
Binary file added plots/data_generation_overhead_large.pdf
View file
Binary file not shown.
Binary file modified plots/legend_only.pdf
View file
Binary file not shown.
Binary file modified plots/makespan_efficiency_allIntoOne_ceph.jpg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified plots/makespan_efficiency_allIntoOne_ceph.pdf
View file
Binary file not shown.
Binary file added plots/makespan_efficiency_allIntoOne_ceph_large.jpg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added plots/makespan_efficiency_allIntoOne_ceph_large.pdf
View file
Binary file not shown.
Binary file modified plots/makespan_efficiency_allIntoOne_nfs.jpg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified plots/makespan_efficiency_allIntoOne_nfs.pdf
View file
Binary file not shown.
Binary file added plots/makespan_efficiency_allIntoOne_nfs_large.jpg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added plots/makespan_efficiency_allIntoOne_nfs_large.pdf
View file
Binary file not shown.
Binary file modified plots/makespan_efficiency_chain_ceph.jpg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified plots/makespan_efficiency_chain_ceph.pdf
View file
Binary file not shown.
Binary file added plots/makespan_efficiency_chain_ceph_large.jpg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added plots/makespan_efficiency_chain_ceph_large.pdf
View file
Binary file not shown.
Binary file modified plots/makespan_efficiency_chain_nfs.jpg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified plots/makespan_efficiency_chain_nfs.pdf
View file
Binary file not shown.
Binary file added plots/makespan_efficiency_chain_nfs_large.jpg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added plots/makespan_efficiency_chain_nfs_large.pdf
View file
Binary file not shown.
Binary file modified plots/makespan_efficiency_chipseq_ceph.jpg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified plots/makespan_efficiency_chipseq_ceph.pdf
View file
Binary file not shown.
Binary file added plots/makespan_efficiency_chipseq_ceph_large.jpg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added plots/makespan_efficiency_chipseq_ceph_large.pdf
View file
Binary file not shown.
Binary file modified plots/makespan_efficiency_chipseq_nfs.jpg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified plots/makespan_efficiency_chipseq_nfs.pdf
View file
Binary file not shown.
Binary file added plots/makespan_efficiency_chipseq_nfs_large.jpg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added plots/makespan_efficiency_chipseq_nfs_large.pdf
View file
Binary file not shown.
Binary file modified plots/makespan_efficiency_fork_ceph.jpg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified plots/makespan_efficiency_fork_ceph.pdf
View file
Binary file not shown.
Binary file added plots/makespan_efficiency_fork_ceph_large.jpg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added plots/makespan_efficiency_fork_ceph_large.pdf
View file
Binary file not shown.
Binary file modified plots/makespan_efficiency_fork_nfs.jpg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified plots/makespan_efficiency_fork_nfs.pdf
View file
Binary file not shown.
Binary file added plots/makespan_efficiency_fork_nfs_large.jpg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added plots/makespan_efficiency_fork_nfs_large.pdf
View file
Binary file not shown.
Binary file modified plots/makespan_efficiency_groupMultiple_ceph.jpg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified plots/makespan_efficiency_groupMultiple_ceph.pdf
View file
Binary file not shown.
Binary file added plots/makespan_efficiency_groupMultiple_ceph_large.jpg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added plots/makespan_efficiency_groupMultiple_ceph_large.pdf
View file
Binary file not shown.
Binary file modified plots/makespan_efficiency_groupMultiple_nfs.jpg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified plots/makespan_efficiency_groupMultiple_nfs.pdf
View file
Binary file not shown.
Binary file added plots/makespan_efficiency_groupMultiple_nfs_large.jpg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added plots/makespan_efficiency_groupMultiple_nfs_large.pdf
View file
Binary file not shown.
Binary file modified plots/makespan_efficiency_group_ceph.jpg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified plots/makespan_efficiency_group_ceph.pdf
View file
Binary file not shown.
Binary file added plots/makespan_efficiency_group_ceph_large.jpg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added plots/makespan_efficiency_group_ceph_large.pdf
View file
Binary file not shown.
Binary file modified plots/makespan_efficiency_group_nfs.jpg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified plots/makespan_efficiency_group_nfs.pdf
View file
Binary file not shown.
Binary file added plots/makespan_efficiency_group_nfs_large.jpg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added plots/makespan_efficiency_group_nfs_large.pdf
View file
Binary file not shown.

0 comments on commit d554aa8

Please sign in to comment.